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DATA PROCESSING APPARATUS r DATA PROCESSING METHOD, AND 
STORAGE MEDIUM STORING COMPUTER- READABLE PROGRAM 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

The present invention relates to data processing 
apparatus and method which can perform data 
communication with various devices connected on a 
communication medium, and a storage medium or the like 

10 which stores a computer-readable program. 
Related Background Art 

In recent years, devices such as a PC (personal 
computer), a printer, a scanner, a digital copying 
machine and a digital camera have been widespread, and 

15 also a network such as a LAN (local area network) has 

been widespread, whereby the need to share the printer, 
a modem and an image reading apparatus on the network 
increases. Thus, by sharing apparatuses and devices on 
the network, an environment capable of using all of 

20 them is in order. 

However, there is no method of functionally 
combining these devices with others. For example, 
there is no method of combining the scanner with the 
printer or combining the digital copying machine with 

25 other scanner to realize a copying function. Further, 
even if there is such a method of combining the 
devices, a special device is necessary to perform this 
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method, or only a specific device can perform this 
method. Thus, such the method is not general. 

Further, in order to enable a user to grasp or see 
a structure of an entire system, a method of displaying 
5 such the structure is devised. However, when such the 
method nothing but displays a list of the devices, it 
is impossible to display, from a viewpoint of an 
arbitrary user as a starting point, a network system 
configuration in consideration of an environment in 

10 which the system structure is disposed. This is 

because, by such a display, the user can not visually 
and easily recognize the system structure at first 
sight. Further, by such the display, even when system 
resources used on the entire network and executing an 

15 identical function are displayed, such the resources 
are all displayed in undifferentiated manner. For 
example, plural printers connected on the network are 
all displayed simply by an identical icon or the like. 
Thus, it is impossible to discriminate the plural 

20 printers respectively having different functions only 

by such the displayed icons. Further, it is impossible 
to correlate the system structure with its operation 
status and display such correlative status. 

Further, since operation status of the device 

25 selected by the user is not defined, the user can not 
confirm such the status until input and output 
processing ends. For example, since the user can not 
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visually confirm the operation status of the selected 
device reflected on the network system configuration, 
he can not visually discriminate in the system 
configuration the operating device from other device or 
5 confirm by which device in the system the input and 
output processing is being performed. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide 

10 data processing apparatus and method which solved such 
problems as described above, and a storage medium which 
stores a computer-readable program. 

Another object of the present invention is to 
provide data processing apparatus and method which can 

15 cause a structure of an entire system including various 
devices to be visually confirmable, cause a user to 
easily grasp or see the entire system, and cause the 
entire system to be effectively used, and a storage 
medium which stores a computer-readable program. 

20 Other objects and features of the present 

invention will become apparent from the following 
detailed description and the attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
25 Fig. 1 is a block diagram showing a structure of a 

system of network devices including a data processing 
apparatus according to the present invention; 



Fig. 2 is a block diagram for explaining a client 
structure in the first embodiment of the present 
invention; 

Fig. 3 is a sectional view for explaining a 
structure of a digital copying machine shown in Fig. 1; 

Fig. 4 is a block diagram for explaining a control 
structure of the copying machine shown in Fig. 3; 

Fig. 5 is a view for explaining a first network 
connection structure displayed on a CRT (cathode-ray 
tube) shown in Fig. 2; 

Fig. 6 is a view showing an example of a 
combination judgment data structure stored in a data 
processing apparatus shown in Fig. 2; 

Fig. 7 is a view showing an example of a copying 
function setting screen displayed on the CRT shown in 
Fig. 2; 

Fig. 8 is a view showing an example of an error 
message displayed on the CRT shown in Fig. 2; 

Fig. 9 is a flow chart showing an example of a 
first data processing procedure in the data processing 
apparatus according to the present invention; 

Fig. 10 is a view showing an example of device 
driver information managed by a data processing 
apparatus according to the second embodiment of the 
present invent ion ; 

Fig. 11 is a view for explaining a second network 
connection structure displayed on the CRT shown in Fig. 
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2; 

Fig. 12 is a view showing an example of a virtual 
operation panel displayed on the CRT of the data 
processing apparatus shown in Fig. 2; 
5 Fig. 13 is a view showing an example of the 

virtual operation panel displayed on the CRT of the 
data processing apparatus shown in Fig. 2; 

Fig. 14 is a view showing an example of the 
virtual operation panel displayed on the CRT of the 
10 data processing apparatus shown in Fig. 2; 

Fig. 15 is a view showing an example of a first 
window displayed, in case of amusement setting, on the 
virtual operation panel of the CRT of the data 
processing apparatus shown in Fig. 2; 
15 Fig. 16 is a view showing an example of a second 

window displayed, in case of amusement setting, on the 
virtual operation panel of the CRT of the data 
processing apparatus shown in Fig. 2; 

Fig. 17 is a view showing an example of a property 
20 screen displayed, according to icon instructions, on 
the virtual operation panel of the CRT of the data 
processing apparatus shown in Fig. 2; 

Fig. 18 is a view showing an example of a resource 
file of device driver information managed by the data 
25 processing apparatus according to the second embodiment 
of the present invention; 

Fig. 19 is a view showing an example of a button 
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editing screen displayed on the virtual operation 
panels shown in Figs. 12 to 14; 

Fig. 20 is a view showing an example of log 
information managed by a data processing apparatus 
5 according to the third embodiment of the present 
invention; 

Fig. 21 is a view showing an example of the log 
information managed by the data processing apparatus 
according to the third embodiment of the present 
10 invention; 

Fig. 22 is a view showing an example of the log 
information managed by the data processing apparatus 
according to the third embodiment of the present 
invention; 

15 Fig. 23 is a view showing an example of the log 

information managed by the data processing apparatus 
according to the third embodiment of the present 
invention; 

Fig. 24 is a view showing an example of the log 
20 information managed by the data processing apparatus 
according to the third embodiment of the present 
invention; 

Fig. 25 is a view showing an example of the log 
information managed by the data processing apparatus 
25 according to the third embodiment of the present 
invention; 

Fig. 26 is a view showing relation between a data 
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processing apparatus registered as a management server 
and a client device, in the data processing apparatus 
according to the present invention; 

Fig* 27 is a view for explaining management server 
5 device information shown in Fig. 26; 

Fig. 28A is a view for explaining in detail PC 
(personal computer) information shown in Fig. 27; 

Fig. 28B is a view for explaining in detail 
printer information shown in Fig. 27; 
10 Fig. 29A is a view for explaining in detail 

scanner information shown in Fig. 27; 

Fig. 29B is a view for explaining in detail FAX 
(facsimile) board information shown in Fig. 27; 

Fig. 30 is a view for explaining server device 
15 information shown in Fig. 26; 

Fig. 31 is a view for explaining client device 
information shown in Fig. 26; 

Fig. 32 is a flow chart showing an example of a 
second data processing procedure in the data processing 
20 apparatus according to the present invention; 

Fig. 33 is a view showing an example of a copying 
function execution screen of a data processing 
apparatus according to the fourth embodiment of the 
present invention; 
25 Fig. 34 is a flow chart showing an example of a 

third data processing procedure in the data processing 
apparatus according to the present invention; 



- 8 - 



Fig. 35 is a flow chart showing an example of a 
fourth data processing procedure in the data processing 
apparatus according to the present invention; 

Fig. 36 is a view showing an example of a warning 
5 message displayed on the CRT shown in Fig. 2; 

Fig. 37 is a view showing an example of an output 
format selection window displayed on the CRT shown in 
Fig. 2; 

Fig. 38 is a flow chart showing an example of a 
10 fifth data processing procedure in the data processing 
apparatus according to the present invention; 

Fig. 39 is a view showing an example of the 
warning message displayed on the CRT shown in Fig. 2; 
Fig. 40 is a flow chart showing an example of a 
15 sixth data processing procedure in the data processing 
apparatus according to the present invention; 

Fig. 41 is a flow chart showing an example of a 
seventh data processing procedure in the data 
processing apparatus according to the present 
20 invention; 

Fig. 42 is a view showing an example of a virtual 
operation panel displayed on the CRT of the data 
processing apparatus shown in Fig. 2; 

Fig. 43 is a view showing an example of a 
25 combination document selection window displayed 

according to icon instructions corresponding to buttons 
displayed on the virtual operation panel of the CRT of 
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the data processing apparatus shown in Fig. 2; 

Fig. 44 is a view showing an example of a 
combination image data selection window displayed 
according to the icon instructions corresponding to the 
5 buttons displayed on the virtual operation panel of the 
CRT of the data processing apparatus shown in Fig. 2; 

Fig. 45 is a flow chart showing an example of an 
eighth data processing procedure in the data processing 
apparatus according to the present invention; and 
10 Fig. 46 is a view for explaining a memory map of a 

storage medium in which various data processing 
programs readable by the data processing apparatus 
according to the present invention are stored. 

15 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

[ First Embodiment ] 

<explanation of apparatus> 

Fig. 1 is a block diagram showing a structure of a 

system of network devices including a data processing 
20 apparatus according to the present invention. 

In Fig. 1, a printer 102 which has open-system 

architecture is connected with a network through an NB 

(network board) 101. The NB 101 is connected with 

LAN's 100, 120 and 130 through a local area network 
25 interface such as an Ethernet interface 10BASE2 having 

a coaxial connector, an Ethernet interface 10BASE-T 

having an RJ-45, or the like. 
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Plural PC T s (personal computers) 103, 104, 111 and 
112 are also connected with the LAN 1 s 100 and 130, 
whereby these PC T s can communicate with the NB 101 
under the control of a network operating system. 

Therefore, one of the PC's (e.g., the PC 103) can 
be used as the PC for network device management. 
Further, a printer 105 may be locally connected with 
the PC 104 as a local printer. 

Further, since a PC 106 which functions as a file 
server is connected with the LAN 100, the PC 106 
manages accessing to files stored in a large-capacity 
(e.g., 10,000,000,000 bytes) network disk 107. 

The PC 104 which functions as a printer server 
manages printing of the printer such as the locally 
connected printer 105, the remotely located printer 102 
or the like. 

Similarly, a PC 115 which functions as a printer 
server manages printing of the printer such as a 
locally connected printer 116, the remotely located 
printer 102 or the like. 

Further, the PC 115 can be functioned as a scanner 
server to manage the scanner such as a remotely located 
scanner 110 or the like. The scanner 110 is connected 
with the LAN 100 through the network board or the like. 
Further, a digital copying machine 118 provides printer 
and scanner functions under the management and control 
of an image processing unit 119. 
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In order to effectively perforin communication 
among various network members, Network software such as 
Novell, UNIX or the like can be used for the network 
shown in Fig. 1. For example, software such as 
5 commercially available NetWare (trademark of Novell) 
can be used. Since the details of this software 
package are described in the on-line documentation 
included in the NetWare package, the explanation 
thereof will be omitted. 

10 Each of the PC's 103 and 104 is a general PC which 

can generate a data file, transmit the generated data 
file to the LAN 100, receive a file from the LAN 100, 
display these files, and/or process these files. 

In Fig. 1, although the personal computer devices 

15 (PC r s) are illustrated, other computer devices suitable 
for executing the network software may be used. For 
example, when UNIX software is used, a UNIX workstation 
may be connected with the network. In this case, the 
connected UNIX workstation is used together with the 

20 illustrated PC T s. 

Ordinarily, the LAN 100 provides services to a 
relatively local user group, e.g., a user group in one 
floor or plural consecutive floors in one building. 

On the other hand, when plural users are located 

25 at positions away from others (e.g., different 

buildings, different prefectures or the like), a WAN 
(wide area network) may be constructed. 
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Basically , the WAN is composed of the plural LAN 1 s 
which are connected together through a high-speed 
digital line such as ISDN ( Integrated Services Digital 
Network). For example, as shown in Fig. 1, when the 
5 LAN 100 and the LAN 120 are connected with each other 
through a backbone 140, the WAN is established. In 
this case, the devices connected with the LAN's 100, 
120 and 130 can access functions of devices connected 
with other LAN's through the WAN. 

10 Fig. 2 is a block diagram for explaining a client 

structure acting as a data processing apparatus 
according to the first embodiment of the present 
invention. It is assumed that, in the client 
structure, predetermined devices (including the 

15 printer, the scanner, the modem, a multifunctional 

image processing apparatus, etc. ) can communicate with 
locally connected other data processing apparatus based 
on a predetermined protocol through a not- shown 
communication medium (e.g., a LAN according to Ethernet 

20 or the like) . 

In Fig. 2, numeral 1 denotes a system bus to which 
later-explained units are connected, and numeral 2 
denotes a CPU (central processing unit). 

Numeral 3 denotes a PMEM (program memory) which 

25 appropriately selects and reads a program for the 
processing, from an HD (hard disk) 10. The read 
program is executed by the CPU 2. Further, data input 
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from a keyboard 12 is stored as code information in -the 
PMEM 3 also acting as a text memory. 

Numeral 4 denotes a communication control unit 
which controls input and output data of a communication 
5 port 5, A signal output from the communication port 5 
is transmitted to a communication port 7 of other 
apparatus on the network through a communication line 
6. 

A printer and an image reading apparatus (e.g., 
10 the scanner) which are shared on the network are 

controlled through the communication control unit 4. 
Although the network such as the LAN is used in the 
present embodiment, it is needless to say that the 
present invention is applicable to a case where the 
15 communication port or the communication line connected 
with the communication control unit 4 is a general 
public line. 

Numeral 8 denotes an external memory control unit 
which controls access to a data file disk such as an FD 

20 (floppy disk) 9, the HD 10 or the like. 

Numeral 11 denotes an input control unit to which 
input devices such as the keyboard 12, a mouse 13 and 
the like are connected. A user issues an operation 
instruction to the system by operating the keyboard 12. 

25 Numeral 16 denotes a CRT (cathode-ray tube) on which a 
PD (pointing device) is used to instruct editing of 
image information. In the present embodiment, the 
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mouse 13 is used as the PD. 

Thus, the user arbitrarily shifts a cursor on the 
CRT 16 in X and Y directions and selects a command icon 
on a command menu to instruct the processing. Besides, 
the user shifts the cursor to indicate an editing 
target, a drawing position and the like. 

Numeral 14 denotes a VRAM (video random-access 
memory) which acts as a video image memory. Drawing 
data (bit map data) which is to be displayed on the CRT 
16 is expanded in the VRAM 14, the expanded data is 
appropriately read by a display output control unit 15, 
and the content of the read data is displayed on the 
CRT 16. Numeral 17 denotes a printer control unit 
which controls data outputting to a connected printer 
18. 

Symbol 1A denotes an image reading device control 
unit which controls image reading of a connected image 
reading device IB. An external device control unit 19 
controls the operation of the external device through 
the printer control unit 17 or the image reading device 
control unit 1A. 

In an image reading server of the present 
invention necessarily includes the image reading device 
control unit 1A and the image reading device IB. 
Incidentally, as described above, a client-side 
apparatus can share these units with the server, 
through the communication control unit 4 and the 
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communication port 5 . 

Further, in the structure of Fig. 2, even if the 
image reading device is physically independent of the 
image reading apparatus, it is assumed that the image 
5 reading apparatus has the function of one component 
including the image reading device. 

In the present embodiment, the program which is 
stored in a ROM (read-only memory) may be stored in the 
HD 10 or the FD 9 directly connected with the 
10 apparatus, or in other apparatus connected with the 
apparatus through the network. Further, the program 
according to the present invention can be supplied to 
the system or the apparatus through the storage medium 
such as the HD 10, the FD 9 or the like, or through the 
1 5 network . 

Fig. 3 is a sectional view for explaining the 
structure of the digital copying machine 118 shown in 
Fig. 1. 

In Fig. 3, numeral 2080 denotes an ADF (automatic 
20 document feeder) which is installed as an option. The 
ADF 2080 feds an original one by one from a sheaf of 
originals put on an original feeding board to an 
original mounting board (platen glass) 200 of the 
copying machine 118. Numeral 2002 denotes a scanner 
25 which is composed of an original illumination lamp 

2003, a scanning mirror 2004 and the like. The scanner 
2002 is reciprocated by a not- shown motor along a 
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predetermined direction to scan the original. Thus, 
reflection light from the original is imaged on a CCD 
(charge-coupled device) in an image sensor unit 2008 
through scanning mirrors 2004, 2005 and 2006 and a lens 
5 2007* 

The image sensor unit 2008 performs predetermined 
image processing to an electrical signal obtained by 
converting the reflection light from the original, to 
generate an image signal . Numeral 2009 denotes an 

10 exposure control unit which is composed of a laser beam 
generation unit, a polygonal scanner and the like. The 
exposure control unit 2009 generates a laser beam 2019 
which is modulated based on the image signal generated 
by the image sensor unit 2008, and irradiates a 

15 photosensitive drum 2011 with the generated beam 2019. 

Numeral 2010 denotes an image formation unit which 
is composed of the photosensitive drum 2011, a primary 
charger 2012, a development unit 2013, a transfer 
charger 2016, a separation charger 2017, a preexposure 

20 lamp 2014, a cleaner 2015 and the like. The primary 
charger 2012, the development unit 2013, the transfer 
charger 2016, the separation charger 2017, the 
preexposure lamp 2014 and the cleaner 2015 are disposed 
around the photosensitive drum 2011. 

25 In the image formation unit 2010, the 

photosensitive drum 2011 is driven by a not-shown motor 
and thus rotated in the direction indicated by an arrow 
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A. The primary charger 2012 charges the photosensitive 
drum 2011 to a predetermined potential. The later beam 
2019 generated by the exposure control unit 2009 is 
irradiated on the photosensitive drum 2011 charged by 
5 the primary charger , 2012, whereby an electrostatic 
latent image is formed. The development unit 2013 
develops the electrostatic latent image formed on the 
photosensitive drum 2011 to visualize the image on the 
drum 2011 as a toner image. 

10 Numerals 2021, 2022, 2023 and 2024 respectively 

denote first, second, third and fourth cassettes which 
hold transfer sheets as recording media. The transfer 
sheet held in the cassette is picked up by a pickup 
roller 2025, 2026, 2027 or 2028, fed to the copying 

15 machine 118 by a pair of sheet feed rollers (simply 
referred as a sheet feed roller hereinafter) 2029, 
2030, 2031 or 2032, and then carried to the image 
formation unit 2010 by a pair of registration rollers 
(simply referred as a registration roller hereinafter) 

20 2033. 

The transfer charger 2016 transfers the visualized 
toner image on the photosensitive drum 2011 to the 
carried transfer sheet. After the toner image is 
transferred to the transfer sheet, the cleaner 2015 
25 cleans residual toner on the photosensitive drum 2011. 
After the residual toner is cleaned by the cleaner 
2015, the preexposure lamp 2014 eliminates the residual 
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charges on the photosensitive drum. 

The separation charger 2017 separates the transfer 
sheet on which the toner image was transferred, from 
the photosensitive drum 2011. Numeral 2034 denotes a 
5 carrying belt which carries the transfer sheet 

separated by the separation charger 2017 r to a fixing 
unit 2035. The fixing unit 2035 presses and heats the 
transfer sheet to fix the toner image on the transfer 
sheet. Numeral 2036 denotes a pair of sheet discharge 

10 rollers ( simply referred as a discharge roller 

hereinafter) which discharges the transfer sheet on 
which the toner image was fixed by the fixing unit 
2035, outside the copying machine (body) 118. 

Numeral 2037 denotes a sheet discharge flapper 

15 which changes the sheet transfer path between a 

carrying path 2038 and a discharge path 2043. Numeral 
2040 denotes a lower carrying path which guides , to a 
sheet refeed path 2041, the transfer sheet carried by 
the sheet discharge roller 2036 and a pair of reversal 

20 rollers ( simply referred as a reversal roller 

hereinafter) 2045 and then reversed through a reversal 
path 2039. 

Numeral 2042 denotes a pair of sheet refeed 
rollers (simply referred as a sheet refeed roller 
25 hereinafter) which refeeds the transfer sheet guided to 
the sheet refeed path 2041 to the image formation unit 
2010. Numeral 2044 denotes a pair of sheet discharge 
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rollers (simply referred as a sheet discharge roller 
hereinafter) which is disposed in the vicinity of the 
sheet discharge flapper 2037 and discharges the 
transfer sheet outside the copying machine 118 when the 
5 sheet transfer path is changed to the sheet discharge 
path 2043- by the flapper 2037. 

When the copying machine 118 performs two-face 
recording (two-face copying), the sheet discharge 
flapper 2037 is moved upward to guide the transfer 

10 sheet to which the copying was performed to the sheet 
refeed path 2041 through the carrying path 2038, the 
reversal path 2039 and the lower carrying path 2040. 
At this time, the reversal roller 2045 completely 
passes the trailing edge of the transfer sheet through 

15 the carrying path 2038 and then carries the sheet to 
the reversal path 2039 up to the position where the 
sheet is nipped by the reversal roller 2045. Then the 
reversal roller 2045 is reversed to carry the sheet to 
the lower carrying path 2040. 

20 When the transfer sheet is reversed and discharged 

outside the copying machine (body) 118, the sheet 
discharge flapper 2037 is moved upward, and the 
transfer sheet is carried to the reversal path 2039 by 
the reversal roller 2045 up to the position where the 

25 trailing edge of the sheet remains in the carrying path 
2038. Then the reversal roller 2045 is reversed to 
reverse and carry the sheet to the sheet discharge 
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roller 2044. 

Numeral 2090 denotes a sheet discharge unit 
(sorter) which is installed as an option, and flushes 
and staples the transfer sheets discharged from the 
5 copying machine 118. Concretely, the transfer sheets 
discharged one by one are stacked and flushed on a 
processing tray 2094 until the discharge of the sheets 
to which image formation of one copy (one sheaf) ends. 
Then the sheaf of transfer sheets is stapled by a not- 

10 shown stapler of the processing tray 2094 , and the 

stapled sheaf is discharged to a sheet discharge tray 
2092 or 2093. Each of the sheet discharge trays 2092 
and 2093 is moved upward and downward by a not-shown 
motor and controlled to reach the position of the 

15 processing tray 2094 before an image processing 
operation is started. 

Numeral 2091 denotes a sheet tray on which 
slipsheets each of which is to be inserted between the 
two continuous transfer sheets discharged are stacked. 

20 Numeral 2095 denotes a Z folder which is installed as 

an option and folds the discharged transfer sheets into 
Z shape. Numeral 2096 denotes a bookbinding unit which 
is installed as an option and performs bookbinding by 
folding the center of the discharged transfer sheets of 

25 one copy and then stapling them. The obtained sheaf of 
transfer sheets is discharged to a sheet discharge tray 
2097. 
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Further, a paper deck (or a sheet deck) 2050 which 
can hold, e.g., 4000 transfer sheets is installed as an 
option in the copying machine (body) 118. A lifter 
2051 of the paper deck 2050 ascends according to a 
5 quantity of the stacked transfer sheets such that the 
uppermost sheet is always in contact with a pickup 
roller 2052, whereby the transfer sheet is fed to the 
body 118 by a pair of sheet feed rollers (simply 
referred as a sheet feed roller hereinafter) 2053. 
10 Further, a multipurpose manual feeder 2054 which can 
hold 100 transfer sheets is installed. 

The development unit 2013 may be a type in which 
toner is refilled by changing a toner cassette, or may 
be a type in which toner is directly refilled. 
15 Further, the development unit 2013 can detect a 
residual toner quantity in the unit 2013 itself. 

Here, although a structure of a monochromatic 
copying machine is explained by way of example of the 
image output apparatus of the present invention, the 
20 present invention is applicable to a color copying 
machine . 

In this case, the development unit 2013 is 
composed of four, i.e., Y (yellow), M (magenta), C 
(cyan) and Bk (black), development parts. Further, the 
25 development unit 2013 can independently detect each of 
residual Y, M, C and Bk toner quantities. 

Further, the copying machine 118 can detect a 
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residual transfer sheet quantity in each of the first 
to fourth cassettes 2021, 2022, 2023 and 2024, and the 
paper deck 2050. The sheet discharge unit (sorter) 
2090 can detect a residual staple quantity in the 
5 processing tray 2094. Since the sheet discharge unit 
(sorter) 2090, the Z folder 2095 and the paper deck 
2050 are the options, they are detachably installed in 
the copying machine (body) 118. 

Fig. 4 is a block diagram for explaining a control 

10 structure of the copying machine 118 shown in Fig. 3. 

In Fig. 4, the same parts as those in Fig. 3 are added 
with the same reference numerals. 

In Fig. 4, numeral 3002 denotes an operation unit 
which is used to perform various setting and instruct 

15 various operations for the digital copying machine 

(body) 118. Numeral 3003 denotes a reader unit which 
is composed of the elements 2001 to 2009 shown in Fig. 
3, reads the original image, and outputs the image data 
corresponding to the original image to a printer unit 

20 3004 and a control unit 3009. The printer unit 3004 

which is composed of the elements 2009 to 2045 shown in 
Fig. 3 outputs the image according to the image data 
from the reader unit 3003 and the control unit 3009 
onto a recording medium. 

25 The control unit 3009 is connected with the reader 

unit 3003, a FAX (facsimile) unit 3006, a network I/F 
(interface) unit 3007 and an HD (hard disk) unit 3008, 
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and entirely controls the copying machine 118. 

The FAX unit 3006 decompresses compressed image 
data received through a telephone line, and transfers 
the decompressed image data to the control unit 3009. 
5 Further, the FAX unit 3006 compresses the image data 
transferred from the control unit 3009, and transmits 
the compressed image data through the telephone line. 
It should be noted that the compressed image data 
received by the FAX unit 3006 can be temporarily stored 

10 in the HD unit 3008. 

The network I/F unit 3007 interfaces the LAN 130 
(Fig. 3) with the control unit 3009. The network I/F 
unit 3007 expands or extracts code data (i.e., PDL 
(page description language) data) representing the 

15 image transferred through the LAN 130 to the image data 
recordable by the printer unit 3004, and then transfers 
the recordable image data to the control unit 3009 . 

The recording unit 3009 is composed of a CPU 3011, 
a ROM 3012, a RAM 3013 and the like. The control unit 

20 3009 controls the data flow among the reader unit 3003, 
the FAX unit 3006, the network I/F unit 3007 and the HD 
unit 3008, on the basis of the data stored in the ROM 
3012 or data received from other parts. 

The HD unit 3008 includes an HD, a page memory and 

25 the like all not shown, and can store the plural image 
data. The plural image data stored in the HD unit 3008 
can be output in the order according to an editing mode 
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instructed by the operation unit 3002 of the digital 
copying machine (body) 118. 

The control unit 3009 can notify the residual 
toner quantity, the residual transfer sheet quantity 
5 for each size, the residual , staple quantity, the 

copying machine status (door open status, sheet jam 
status, etc.), presence/ absence of the various options 
(the sheet discharge unit (sorter) 2090, the Z folder 
2095, the paper deck 2050, etc. in Fig. 3) and the 

10 like, to the LAN 130 through the network I/F unit 3007, 
or to each device connected through the WAN composed of 
the LAN's 130, 100 and 120 in Fig. 1. 

Fig. 5 is a view showing a screen displayed on the 
CRT 16 of the data processing apparatus, e.g., a PC 

15 shown in Fig. 2, and for explaining a first network 
connection structure . 

In Fig. 5, numeral 301 denotes a main window in 
which a menu, a tool bar, icons representing PC's 
( including a user 1 s own apparatus and other 

20 apparatuses) and peripheral devices (scanners, 

printers, FAX machines, etc.), and icons 301a to 301f 
on the tool bar representing functions respectively 
performed or executed by operating the PC's and the 
peripheral devices are displayed. 

25 For example, the icon 301a is used to execute a 

copying function for reading the image data from the 
selected scanner and outputting the read image data to 
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the selected printer. The icon 301b is used to execute 
a FAX (facsimile) function. 

The icon 301c is used to execute an image data 
reading function. The icon 301d is used to execute a 
5 function for reading the image data and performing OCR 
(optical character recognition) processing. 

The icon 301e is used to execute a function for 
displaying PC (personal computer) information, and the 
icon 301f is used to execute a function for displaying 
10 each personal tray data. Numeral 302 denotes a system 
display window. 

In the system window 302, symbols 302a to 302z 
denote icons which respectively represent the PC 1 s and 
the peripheral devices shared on the network shown in 
15 Fig. 1. The displayed icons are changed according to 
the kind of device (e.g., PC, printer, scanner, FAX 
modem or the like) or the status (e.g., "in 
processing" , "error occurrence" or the like). 

Numeral 302a denotes the root icon, numeral 302b 
20 denotes the icon representing a domain by which the 

user's own apparatus (displayed as "my machine") logs 
on, and numeral 302c denotes the icon representing own 
apparatus. The user's own apparatus is a special 
device and thus displayed independently of other PC's. 
25 The icons 302m and 302p respectively represent the 

peripheral device and the PC which are shared on the 
network but for which any driver is not installed. 
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Thus, the icons 302m and 302p are displayed in gray. 

The icon 302d represents that the scanner is 
scanning the image now. At the icon 302n, e.g., a 
numeral "3" representing that three jobs are spooled in 
5 the printer is displayed. 

The icon 302z represents that the printer in which 
a driver has been installed can not be used because of 
some reasons (e.g., breakdown, toner empty, no sheet, 
etc.). As above, it is possible by using the screen 

10 shown in Fig. 5 to graphically recognize the connection 
statuses and conditions of all the PC T s and peripheral 
devices on the network. In the present embodiment, 
although all icons are not displayed for the 
convenience of screen, the user can confirm the 

15 connection statuses of all PC's and peripheral devices 
by using an SB (scroll bar) disposed at the side of the 
screen. 

Fig. 6 is a view showing an example of a 
combination judgment data structure stored in the data 
20 processing apparatus shown in Fig. 2. For example, the 
combination judgment data structure is stored in the HD 
10. 

In Fig. 6, numerals 601 and 602 denote header 
segments. The header segment 601 corresponds to the 
25 number of combination functions registered, and the 
head segment 602 corresponds to a comment. 

Each of segments 603a to 603d corresponds to one 
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function data. The segment 603a corresponds to first 
device data, and the segment 603b corresponds to second 
device data. In the present embodiment, the first 
device data represents the scanner, and the second 
device data represents the printer. Such a combination 
is effective (or valid) even if opposite. The segment 
603c corresponds to a function (a copying function in 
the present embodiment) which is executable by 
virtually combining the above plural functions (scanner 
and printer functions in the present embodiment) with 
others, and the segment 603d corresponds to a comment. 
In the present embodiment, N registered functions can 
be stored as the combination judgment data structure, 
and the Nth function corresponds to segments 604a to 
604d. 

Fig. 7 is a view showing an example of a copying 
function setting screen displayed on the CRT 16 of the 
data processing apparatus shown in Fig. 2. When the 
scanner icon shown in Fig. 5 is dragged and dropped on 
the printer icon, if such a combination is judged to be 
effective, this combination is displayed on the CRT 16. 

The reason why the copying function setting screen 
is displayed will be explained as follows. That is, 
the devices (i.e., the scanner and the printer in the 
present embodiment) dragged and dropped on the screen 
of Fig. 5 are disposed at physically distant locations 
respectively, but electrically connected with each 
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other through a communication path to be able to 
perform data communication. The scanner can perform at 
least image input processing as an executable function, 
and the printer can perform at least image output 
processing as an executable function. Namely, although 
these devices are disposed at the locations physically 
distant from each other, when the functions of these 
devices are appropriately combined with each other, it 
is possible to execute the copying function. 
Therefore, a screen as in Fig* 7 is displayed such that 
the user of the data processing apparatus can operate 
these two peripheral devices as if one device, thereby 
causing the user to be able to unconsciously use the 
two peripheral devices as one device. It should be 
noted that, when the combination of the devices 
designated by a drag-and-drop operation is changed, the 
displayed setting screen of Fig. 7 is also changed. 

In Fig. 7, numerals 401 and 402 denote 
magnification setting buttons (simply called buttons). 
The button 401 is depressed to instruct ordinary same- 
size output, and the button 402 is depressed to 
instruct reduction/enlargement output, whereby desired 
magnification can be designated. 

Numerals 403 and 404 denote buttons which function 
as input and output sheet setting buttons, 
respectively. When the buttons 403 and 404 are 
depressed, a dialog box for setting a sheet size, a 
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sheet direction and the like is displayed , whereby the 
sheet size and the sheet direction can be set. Numeral 
405 denotes a button which functions as an input image 
color mode setting button. By using the button 405, a 
5 color mode, a monochrome mode, a gray scale mode and 
the like can be set. 

Numeral 406 denotes a setting content confirmation 
display area. The setting content (the copying 
function in the present embodiment) which is based on 

10 the functions determined by the combination of the 

icons are displayed in the area 406. Concretely, the 
magnification "100% (same size)", the longitudinal 
input sheet "A4" , the longitudinal output sheet "A4", 
the color copying mode "COLOR" and the like are 

15 displayed. 

Numeral 407 denotes ten key buttons which are used 
to set the number of output copies, and numeral 408 
denotes a layout adjustment setting button (simply 
called a button). When the button 408 is depressed, a 

20 dialog box by which sheet output position setting, 2- 
in-1 output setting and the like can be performed is 
displayed. 

Numeral 409 denotes a slider by which a desired 
density setting can be performed according to user's 
25 operation and instruction with the mouse 13. Numeral 
410 denotes a slider by which desired image style 
setting can be performed according to user ! s operation 
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and instruction with the mouse 13. 

Numeral 411 denotes a preview area in which an 
input size, an output size and an output area (or a 
image producible area) are displayed. Numeral 412 
5 denotes a button which is used to change input and 

output devices. When the button 412 is depressed , a 
dialog box for setting input and output devices 
different from the input and output devices set by the 
icons is displayed, whereby the user can select the 

10 intended input and output devices. Numeral 413 denotes 
a button. When the button 413 is depressed, the 
current copying function setting is reset r and thus 
predetermined standard copying function setting becomes 
effective. Numeral 414 denotes a stop button, and 

15 numeral 415 denotes a copying execution button. 

Fig. 8 is a view showing an example of an error 
message displayed on the CRT 16 shown in Fig. 2. When 
the CPU 2 judges based on stored judgment information 
that the icons combined by user ' s mouse operation do 

20 not make an effective (or valid) combination, the error 
message is displayed on the display screen shown in 
Fig. 5. 

In Fig. 8, numeral 501 denotes an error message 
dialog box which is displayed when the combination of 
25 the icons is not effective. 

in the present embodiment, it is judged whether or 
not the combination is effective based on the point to 
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which the drag-and-drop operation is performed, and the 
error message is displayed. However, it is possible to 
judge the combination based on the point to which the 
drag operation is performed and then disable the user 
5 from performing the drop operation. 

Fig* 9 is a flow chart showing an example of a 
first data processing procedure in the data processing 
apparatus according to the present invention. The 
first data processing procedure corresponds to a 

10 combination function processing procedure according to 
system structure display processing. 

Initially, in a step S201, the connection 
information of all the PC f s and the peripheral devices 
of Fig. 1 shared on the network and use conditions and 

15 status information of these devices are acquired, and 
the acquired information is stored in the PMEM 3 of 
Fig. 2. Next, in a step S202, the device driver 
information installed in the user's own apparatus is 
checked and acquired. In a step S203, the screen for 

20 simultaneously displaying the system structure and the 
system status shown in Fig. 5 is displayed on the CRT 
16 of the user's own apparatus, on the basis of the 
acquired information. 

Next, in a step S204, when execution of each 

25 function is instructed, it is judged whether or not 

such an instruction is effective. For example, on the 
screen shown in Fig. 5, when the scanner icon 302d is 
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dragged to and dropped on the printer icon 302n by 
using the mouse to execute the copying function, it is 
judged whether or not the combination of the scanner 
and the printer is effective. 

If judged that the combination is not effective, 
the flow advances to a step S205 to display the error 
message on the CRT 16 as shown in Fig. 8. 

Conversely, if judged in the step S204 that the 
combination is effective, the flow advances to a step 
S206 to display a corresponding- function window. In 
the present embodiment, the setting screen for the 
copying function shown in Fig. 7 is displayed on the 
CRT 16. 

Next, it is judged in a step S207 whether or not 
the copying is to be performed. When the button 414 of 
the virtual operation panel shown in Fig. 7 is 
depressed to instruct a copying stop, the processing 
ends. 

When the button 415 is depressed to instruct the 
copying, the flow advances to a step S208 to perform 
the copying according to the setting. Namely, in this 
case, an original image set in the existential scanner 
corresponding to the dragged icon on the screen of Fig. 
5 is input, the image is transferred through the 
network to the existential printer corresponding to the 
icon on which the dragged icon is dropped, and this 
printer performs the processing based on the input 
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setting on the screen shown in Fig. 7 and forms the 
image on the sheet. 
[Second Embodiment] 

In the above-described first embodiment, it was 
5 explained the case where the device driver information 
is acquired from the network by communicating with the 
network device when each PC on the network is powered, 
and the device connection information and the operation 
status of each device are virtual-displayed graphically 

10 by using the integrated-shaped icons which are 

different for the respective devices. However, the 
devices to be connected with the network are not 
limited to the printer and the scanner as described in 
the first embodiment. Namely, the present invention is 

15 also applicable to a case where a multifunctional 

device including the printer and scanner functions or a 
combination of these functions and other functions 
(including the FAX function, a database function, etc.) 
is connected with the network. Hereinafter, the second 

20 embodiment will be explained. 

Fig. 10 is a view showing an example of the device 
driver information managed by the data processing 
apparatus according to the second embodiment of the 
present invention. For example, it is assumed that, 

25 when initialization processing such as a PC power-up 
operation or the like is performed, or when a later- 
described icon is depressed, the device driver 
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information of a multifunctional device (e.g., the 
digital copying machine 118 managed by the respective 
devices shown in Fig. 1) connected with the network is 
acquired from the PC on the network, and the acquired 
5 information is managed on the PMEM 3 or the HD 10. 

When a management server for managing the device driver 
information is connected with the network, the device 
driver information may be acquired from the management 
server. 

10 In Fig. 10, numeral 800 denotes acquirement 

information, and numeral 801 denotes a header segment 
which is composed of a driver name, version information 
and a comment. 

Numeral 802 denotes a page setting information 

15 segment which is composed of page setting information 
(an original size, an output sheet size, a printing 
direction, a page layout, magnification, and a stamp). 
Here, for example, "A4", "A3", n B4" and the like are 
selectable as the original size and the output sheet 

20 size, "longitudinal", "lateral" and the like are 

selectable as the printing direction, "1 page/sheet", 
"2-in-l ,r and the like are selectable as the page 
layout, "100%", "141%" and the like are selectable as 
the magnification, and "secret", "confidential 11 and the 

25 like are selectable as the stamp. 

Numeral 803 denotes a finish information segment 
which is composed of a printing method, a binding 
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direction and a sheet discharge method. Here, for 
example, "ordinary printing", "bookbinding printing", 
"two- face printing", "OHP printing" and the like are 
selectable as the printing method, "longitudinal", 
5 "lateral" and the like are selectable as the binding 
direction, and "sorting", "grouping" , "rotation 
sorting" and the like are selectable as the sheet 
discharge method. 

Numeral 804 denotes a sheet feed information 

10 segment which is composed of various sheet feed setting 
information (a sheet feed method, and an OHP printing 
detail setting). Here, for example, "cassette 1", 
"manual feed" and the like are selectable as the sheet 
feed method, and "sheet feed port when OHP printing 

15 setting", "intermediate sheet designation", "sheet 

type" and the like are selectable as the OHP printing 
detail setting. 

Numeral 805 denotes a device setting information 
segment which is composed of sheet feed option 

20 information and sheet discharge option information (a 
sheet feed option, and a sheet discharge option). 
Here, for example, "sheet feed option device setting" 
is selectable as the sheet feed option information and 
"sheet discharge option device setting" is selectable 

25 as the sheet discharge option information. 

In the first embodiment, the identical icon is 
used for the same- type device. However, in the present 
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embodiment , icon information which represents an icon 
close (or similar) to a rough appearance of an actual 
product for each maker (or manufacturer) is previously 
stored and displayed, whereby the user can visually 
5 recognize an icon of the same- type device of other 

maker. As shown in Fig, 11, a maker name and a device 
name may be displayed nearby the corresponding Icon. 

In this case, it is assumed that, when the device 
corresponds to color image processing, a CM (color 

10 mark: Fig. 11) representing color correspondence is 
added to the device icon. 

The display of the icon is controlled based on the 
device driver information which is managed on the HD 10 
or the PMEM 3. 

15 Since the device driver information uses 

information which concerns a device mode supported by 
device driver information, even if a new peripheral 
device (including an option device) is provided by the 
maker, the image processing apparatus can quickly cope 

20 with the newly provided device only by installing the 
device driver information thereof. 

Fig. 11 is a view showing a system structure 
status screen displayed on the CRT 16 of the data 
processing apparatus shown in Fig. 2, and for 

25 explaining a second network connection structure. In 
Fig. 11, it should be noted that the same parts as 
those in Fig. 5 are added with same symbols, 
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respectively . 

In Fig. 11, symbols 301g to 301 j denote icons. 
When the icon 301g is indicated by the cursor and the 
mouse 13 is then clicked, the screen display is changed 
5 to a not-shown favorite display. Namely, the system 
display window is divided, and the entire system and 
the device icons in the system structure which are 
frequently used for the user in his own apparatus and 
have been registered as the favorites are displayed in 

10 the divided window. 

The icon 301h is indicated when the system display 
window 302 is changed to an editing screen for 
registering the icons in a favorite window. The icon 
301i is indicated when the content of the system 

15 display window 302 is updated. The icon 301 j is 

indicated when a program for displaying the system 
display window 302 is stopped. 

Symbols 302g to 302u denote icons which 
respectively represent other PC ? s connected with the 

20 network. Symbol 302f denotes an icon which represents 
a multifunctional device such as the digital copying 
machine 118 shown in Fig. 1. At the icon 302f, e.g., a 
numeral "3" representing that three jobs are spooled in 
the copying machine is displayed. It should be noted 

25 that, as the icon 302f , an inherent icon different from 
the icons of the input and output device connected with 
the network devices and its device name are displayed. 
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Symbols 303a to 303m denote icons which represent 
the input and output devices connected with the network 
devices, respectively- These icons 303a to 303m are 
the inherent icons (i.e., the icons of which shapes are 
5 extremely close to actual appearances of the bodies to 
be connected, respectively) which are specified by the 
device names respectively, and their connection 
statuses and operation statuses are displayed. Here, 
"X" (impossibility) mark is now overlaid on the icon 

10 303m 7 whereby the current device represented by the 
icon 303m can not be selected due to some troubles. 
Further, the icons (303a and 303f in this case) 
representing the devices which have been connected but 
to which any driver is not installed are displayed in 

15 gray. 

Each of Figs. 12, 13 and 14 is a view showing an 
example of a virtual operation panel displayed on the 
CRT 16 of the data processing apparatus shown in Fig. 
2. When the scanner icon (e.g., 302d, 303c or the 

20 like) dragged in the status that an icon 302f shown in 
Fig. 11 is effectively displayed is dropped on the icon 
302f , the virtual operation panel is displayed as the 
image by which the user can confirm the digital copying 
machine 118 and the connected option devices, by 

25 referring to the device driver information acquired 

from the digital copying machine 118 corresponding to 
the icon 302f and managed in the HD 10 or the PMEM 3. 
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Namely, the virtual operation panel to be displayed is 
changed according to the kind of dragged and dropped 
icon. In Figs. 12 to 14, it should be noted that the 
same parts as those in Fig. 7 are added with same 
5 numerals and symbols, respectively. 

In Figs. 12 to 14, symbols Bl to B8 denote 
buttons. The buttons Bl to B6 are the operation 
buttons which are inherent for the digital copying 
machine 118 and substantially equivalent to the content 

10 displayed on the operation panel of the digital copying 
machine 118. Namely, the button Bl is depressed by a 
cursor operation when the page layout is set. In the 
page layout, various N-in-1 layout including 2-in-l 
layout or layout of outputting one image to every 

15 plural sheets is included. In a default status, the 
output image corresponding to the sheet size "A4" and 
lateral writing output is displayed. 

The button B2 is depressed when the two- face 
printing is designated, the button B3 is depressed when 

20 the bookbinding processing is performed, the button B4 
is depressed when the OHP printing is designated, and 
the button B5 is depressed when the stapling being a 
sheet discharge option of the digital copying machine 
118 is designated. The button B6 is depressed when the 

25 stamp output is performed. In the stamp output, the 

stamp information (image) such as "SECRET" is added to 
(overlaid on) the output image information, and an 
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obtained composite image is output. 

It should be noted that the functions which are 
set by using the buttons Bl to B6 are the functions 
which belong to the digital copying machine 118. 
5 The button B7 is depressed when the function which 

does not belong to the digital copying machine 118 but 
can be set by the PC side is executed. In the present 
embodiment, this function is called favorite setting 
(later described), and two kinds of setting (image 

10 effect setting and stamp setting) are prepared as the 
favorite setting. The button B8 is depressed when the 
copying mode setting is reset to the standard mode. 

Symbols PV1 and PV2 denote preview areas in which 
effect images selected according to the favorite 

15 setting designated by the PC side are displayed. In 

the present embodiment, a mosaic image is displayed in 
the preview area PV1, and a secret stamp is displayed 
on the preview area PV2 . 

Resolution which is adjusted by a slider 410 is 

20 automatically set in 1/2 of the highest resolution of 
the selected output device side, in consideration of 
traffic of the image data managed on the network. 
Further, it is assumed that the resolution which is 
identical or close to the automatically set resolution 

25 is automatically set as the resolution of the input 
device side. 

The highest resolution of the copying machine 
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corresponding to color processing is 600dpi. 
Therefore, when the image is input from the color- 
correspondence scanner, the screen shown in Fig, 12 
represents that the input resolution of the scanner 
5 side is set to 300dpi being 1/2 or so of the output 
resolution of the printer side. 

Similarly, it is assumed that, in consideration of 
traffic of the image data managed on the network, the 
resolution of, e.g., 1/2 or so of the reading 

10 resolution set in the scanner corresponding to the 

dragged scanner icon is automatically set. However, it 
is possible to increase or decrease the resolution 
according to a user T s demand . 

Symbol MFI denotes a system image. When the 

15 scanner icon which is dragged in the status that the 
icon 302f of Fig. 11 is effectively displayed is 
dropped on the icon 302f, the system image MFI is 
displayed on the CRT 16 by referring to the device 
driver information acquired from the corresponding 

20 digital copying machine 118 and managed in the HD 10 or 
the PMEM 3 such that the user can confirm the option 
device connected with the digital copying machine 118. 
It should be noted that a sheet feed unit of the system 
image MFI is displayed such that an automatically 

25 selected sheet feed unit distinguishable from other 
sheet feed units. 

Icons 403a and 404a function input and output 
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sheet setting buttons, respectively. When the icon 
403a or 404a is depressed, a dialog box (e.g., shown in 
later-described Fig. 17) for setting a sheet size, a 
sheet direction and the like is displayed. Thus, 
5 various detail setting including the sheet size, the 

sheet direction, the color/monochrome mode and the like 
can be set. 

Fig. 15 is a view showing an example of a first 
window displayed which is displayed in case of 

10 amusement setting, on the virtual operation panel of 
the CRT 16 of the data processing apparatus shown in 
Fig. 2. Especially, after the button B7 of Fig. 14 and 
the like is depressed, the screen of Fig. 15 is 
displayed when "effect" is selected on a not-shown 

1 5 menu . 

In Fig. 15, numeral 811 denotes an original image 
which corresponds to an original image example input 
from the scanner. Numerals 811-1 to 811-8 denote 
effect image examples. The effect image 811-1 

20 corresponds to the image example subjected to color 

reverse processing, the effect image 811-2 corresponds 
to the image example subjected to embossment 
processing, the effect image 811-3 corresponds to the 
image example subjected to mosaic processing, the 

25 effect image 811-4 corresponds to the image example 

subjected to posterization processing, the effect image 
811-5 corresponds to the image example subjected to 
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soft: focus processing, the effect image 811-6 
corresponds to the image example subjected to sharpness 
processing, the effect image 811-7 corresponds to the 
image example subjected to oil painting processing, and 
5 the effect image 811-8 corresponds to the image example 
subjected to noise addition processing. In the present 
embodiment, since the effect image 811-3 is selected 
now, the mosaic processing is displayed in the preview 
area PV1 of the virtual operation panel of Fig. 13. 
10 Here, when a button 811-9 is depressed, the selected 
effect image can be settled, and when a button 811-10 
is depressed, the selected effect image can be 
cancelled . 

Such effect processing is performed, by performing 
15 predetermined image processing calculation to the 

scanner image data according to an image application on 
the PC side. 

Fig. 16 is a view showing an example of a second 
window displayed, in case of amusement setting, on the 

20 virtual operation panel of the CRT 16 of the data 
processing apparatus shown in Fig. 2. Especially, 
after the button B7 of Fig. 14 and the like is 
depressed, the screen of Fig. 16 is displayed when 
"stamp" is selected on a not-shown menu. 

25 In Fig. 16, numerals 821 and 822 denote buttons. 

When the button 821 is depressed, the stamp (reversely 
displayed) selected in a stamp list 824 is settled, and 
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when the button 822 is depressed, the selected stamp is 
cancelled- A button 823 is depressed to display a help 
screen for the stamp processing. 

Symbols 826X and 826Y denote sliders. By the 
5 sliders 826X and 826Y, the position at which the stamp 
is allocated within the output sheet can be set 
independently for each of X and Y directions. In the 
present embodiment, stamp information 825 is set at the 
center of the currently output image. 

10 The stamp information registered in the stamp list 

can be newly added and deleted. Namely, the stamp 
information which was intended by the user and 
generated and printed by the application or the like, 
the image data which was input from the scanner, or the 

15 image which was edited by combining the stamp 

information and the image data has been stored and 
managed in the HD 10 or the like. These stamps are 
executed not by the function of the copying machine but 
by the function of the PC. 

20 Fig. 17 is a view showing an example of a property 

screen displayed, according to icon instructions, on 
the virtual operation panel of the CRT 16 of the data 
processing apparatus shown in Fig. 2. Especially, when 
the icon 403a shown in Fig. 14 and the like is 

25 depressed or indicated, the property screen is 

displayed on the basis of the device driver information 
acquired in the drag-and-drop operation for the input 
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and output devices. 

In Fig. 17, numeral 830 denotes a property screen 
on which various image input conditions can be freely 
set for, e.g., the scanner. For example, "A4" is now 
5 set to a sheet size area 831, "black and white (or 

monochrome ) " is now set to a mode area 832, and " FAX 
(200dpi)" is now set to a resolution area 834. 
Numerals 833, 835 and 836 denote sliders. A threshold 
of gradation is set by using the slider 833, contrast 

10 is set by using the slider 835, and brightness is set 
by using the slider 836. Numerals 837 and 838 denote 
buttons. When the button 837 is depressed, the set 
content is settled, and when the button 838 is 
depressed, the set content is cancelled. 

15 Fig. 18 is a view showing an example of a resource 

file of the device driver information managed by the 
data processing apparatus according to the second 
embodiment of the present invention. For example, the 
resource file corresponds to the resource file of each 

20 device which is unitarily managed by a not-shown 

management server when initialization processing such 
as a PC power-up operation or the like is performed, or 
when a later-described icon is depressed. The resource 
file is acquired from the management server. 

25 In Fig. 18, numeral 800 denotes acquirement 

information, and numeral 801 denotes a header segment 
which is composed of a driver name, version information 
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and a comment . 

Numeral 802 denotes a page setting information 
segment which is composed of resource offset 
information and page setting information (an original 
5 size, an output sheet size, a printing direction, a 
page layout, magnification, and a stamp). Here, for 
example, "A4", "A3", n B4" and the like are selectable 
as the original size and the output sheet size, 
"longitudinal", "lateral" and the like are selectable 

10 as the printing direction, "1 page/sheet", "2-in-l" and 
the like are selectable as the page layout, "100%", 
"141%" and the like are selectable as the 
magnification, and "secret", "confidential" and the 
like are selectable as the stamp. 

15 Numeral 803 denotes a finish information segment 

which is composed of the resource offset information, a 
printing method, a binding direction and a sheet 
discharge method. Here, for example, "ordinary 
printing", "bookbinding printing", "two-face printing", 

20 "0HP printing" and the like are selectable as the 

printing method, "longitudinal", "lateral" and the like 
are selectable as the binding direction, and "sorting", 
"grouping", "rotation sorting" and the like are 
selectable as the sheet discharge method. 

25 Numeral 804 denotes a sheet feed information 

segment which is composed of the resource offset 
information and various sheet feed setting information 
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(a sheet feed method, and an OHP printing detail 
setting). Here, for example, "cassette 1", "manual 
feed" and the like are selectable as the sheet feed 
method, and "sheet feed port when OHP printing 
5 setting" , "intermediate sheet designation", "sheet 

type" and the like are selectable as the OHP printing 
detail setting. 

Numeral 805 denotes a device setting information 
segment which is composed of the resource offset 

10 information, sheet feed option information and sheet 

discharge option information (a sheet feed option, and 
a sheet discharge option). Here, for example, "sheet 
feed option device setting" is selectable as the sheet 
feed option information and "sheet discharge option 

15 device setting" is selectable as the sheet discharge 
option information . 

Numeral 806 denotes a resource data segment in 
which inherent image information (image parts) 
including various icon image data for displaying the 

20 system structure of each device is stored. The 

updatable resource data which is stored in the resource 
data segment 806 is used when the system structure 
status screens shown in Figs. 5, 11 and 33 (later 
described), the screens shown in Figs. 12 to 14, and 

25 the like are displayed on the CRT 16. 

Thus, for example, even if an option unit is 
connected with the multifunctional device on the 
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network and thus the function of this device is 
expanded, it is possible to freely cope with such a 
situation by acquiring a latest resource file from the 
server, whereby a function-expanded virtual panel or 
5 button can be displayed (see the screens of Figs. 12 to 
14 and the like) . 

Fig. 19 is a view showing an example of a button 
editing screen displayed on the virtual operation 
panels shown in Figs. 12 to 14. 

10 In Fig. 19, numeral 850 denotes an editing window. 

A button which is intended to be displayed is selected 
from a group of function buttons displayed on a 
function list area 851, and shift buttons 853 and 854 
are operated to shift the selected button between the 

15 function list area 851 and a display function area 852, 
thereby editing the buttons to be displayed. 

Numeral 855 denotes a button layout display area 
in which the buttons to be displayed in correspondence 
with the buttons Bl to B6 shown in Fig. 12 and the like 

20 are arranged in user's selected order (this order can 
be changed by using the mouse or the like). It is 
assumed that, when a not-shown editing button displayed 
on the virtual operation panel is depressed, an editing 
program is read from the HD 10, whereby the button 

25 editing screen is initiated (i.e., displayed). 

Thus, after the buttons intended to be displayed 
are edited, the buttons to be displayed are cancelled 
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or set by a button 856 or 857. 

Hereinafter, a data processing procedure will be 
explained. The data processing procedure is executed 
by the CPU 2 shown in Fig. 2, on the basis of the 
program stored in the HD 10 or the like. 

Initially, when display/non-display is designated 
by using the button 853 or 854 on the editing window 
850, the selected button is shifted from the function 
list area 851 to the display function area 852, or from 
the area 852 to the area 851, and displayed. 

Next, when the change of the button layout is 
instructed in the button layout display area 855 on the 
editing window 850, a layout of the buttons in the area 

855 is changed and displayed according to the 
instruction . 

Next, when the setting is instructed by using the 
button 857 on the editing window 850, the setting on 
the window 850 is acquired and stored as setting 
function button layout information in the HD 10 or the 
like shown in Fig. 2, and the editing window 850 is 
closed. 

When the cancel is instructed by using the button 

856 on the editing window 850, the setting on the 
window 850 is cancelled, and the editing window 850 is 
closed. 

By the above processing, the function buttons (Bl 
to B8 of Figs. 12 to 14) on the virtual operation panel 
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can be edited (i.e., the arrangement order and display 
can be set) by using the editing window 850 shown in 
Fig. 19, thereby further increasing function setting 
operability . 
5 [Third Embodiment] 

In the above-described embodiment, it was 
explained the case where the desired function 
processing is performed by the drag-and-drop operation 
for the virtually displayed icons of the scanner and 

10 the printer or of the scanner and the multifunctional 
device. However, the management server on the network 
can sequentially manage the information concerning a 
resource remaining quantity for each printer by 
managing such the combined function or a log for each 

15 device. Thus, log information is acquired when a log 

demand is issued from the PC on the network or when the 
function is executed, whereby it is possible to display 
whether or not the set function can be executed or to 
effectively use the log information for each device. 

20 Hereinafter, the third embodiment will be explained. 

Fig. 20 is a view showing an example of the log 
information managed by a data processing apparatus 
according to the third embodiment of the present 
invention. In the present embodiment, either of PC 1 s 

25 on the network shown in Fig. 1 is registered as the 

management server, and the registered management server 
manages the function log information. 



- 51 - 



In Fig. 20, numeral 860 denotes the function log 
information which is composed of a header segment 861 
and function log information segments 862-1 to 862-N. 

Numeral 863 denotes a segment which corresponds to 
5 a function (e.g., a copying function) capable of using 
the network device. In the segment 863, discrimination 
information of the copying function is set. Numeral 
864 denotes a segment which corresponds to the number 
of registered binds. The number of binds is the value 

10 which is counted every time a bind function is 
executed. Numeral 865 denotes a segment which 
corresponds to a scanner ID (identification). In the 
segment 865, a device ID corresponding to the dragged 
and dropped icon (scanner) on the network is set. 

15 Numeral 866 denotes a segment which corresponds to a 
printer ID. In the segment 866, a device ID 
corresponding to the dragged and dropped icon (printer) 
on the network is set. 

Numeral 867 denotes a segment which corresponds to 

20 the number of uses. In the segment 867, the number of 
copying operations based on the identical combination 
is accumulatively counted and set. Numeral 868 denotes 
a segment which corresponds to a comment. 

When the function execution is started by using 

25 the icon dragged and dropped by the user who operates 
the PC on the network, the function log information is 
notified to the management server and stacked on the HD 
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in "this server. 

Further , according to an acquirement demand from 
the user on the network, the function log information 
managed by the management server is read and 
5 transferred to the demand sender's PC. The transferred 
function log information is maintained or subjected to 
data processing and then displayed in a list form or a 
visual form on the demand sender's PC. 

Fig. 21 is a view showing an example of the log 

10 information managed by the data processing apparatus 
according to the third embodiment of the present 
invention. In the present embodiment, either of PC's 
on the network shown in Fig. 1 is registered as the 
management server, and the registered management server 

15 manages the device log information. 

In Fig. 21, numeral 870 denotes printer log 
management information which is composed of a header 
segment 871 and printer log information segments 872-1 
to 872-M. It should be noted that symbol M denotes the 

20 number of discriminating printers on the network. 

Numeral 873 denotes a segment which corresponds to 
a printer name. In the segment 873, the printer name 
determined based on the device driver information is 
automatically set. Numeral 874 denotes a segment which 

25 corresponds to the number of logs. In the segment 874, 
the value Nl which is obtained by accumulatively 
counting the number of logs in the printer is set. 
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Numeral 875 denotes a segment which corresponds to a 
comment. Numerals 876-1 to 876-N denote segments which 
correspond to log detail information. In the segments 
876-1 to 876-N, input information (an application name 
5 or the like), the number of total printing pages, a 
preset sheet size, a longitudinal size of non-preset 
sheet, a lateral size of non-preset sheet, color 
printing/monochrome printing, one face/two faces, a 
toner use quantity, and the like are set. The toner 

10 use quantity is set based on toner use quantity 
information notified by the printer every time a 
printing job by the printer ends. Each log information 
is occasionally updated and managed in the HD of the 
management server . 

15 Therefore, every time each printer on the network 

executes the job, latest log information is updated. 
Thus, when the printer function or the copying function 
is executed on the PC of the network, the log 
information might be used as judgment information to 

20 judge whether or not the set job can be executed with 
the current toner quantity. Therefore, when a command 
to demand the printer log management information is 
received from the PC on the network (e.g., when the 
user's operation to drag and drop the scanner icon to 

25 the printer icon to execute the copying function is 
issued as the key to the management server), the 
management server notifies the printer log management 
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information managed based on ID (-the printer name) of 
the designated icon, to the PC of the demand sender. 

Figs. 22, 23, 24 and 25 are views showing examples 
of the log information managed by the data processing 
5 apparatus according to the third embodiment of the 

present invention. In the present embodiment, either 
of PC's on the network shown in Fig. 1 is registered as 
the management server, and the registered management 
server manages the log information for each job. 

10 Fig. 22 shows job information which is managed 

when a FAX function job is executed and corresponds to 
log item information in a reception folder. 
Concretely, a sender, a FAX number, date, a reception 
result, a reception time, a reception page, error 

15 information, resolution, a compression system and the 
like are managed as the log information by the 
management server . 

Fig. 23 shows job information which is managed 
when the FAX function job is executed and corresponds 

20 to log item information in a transmission-end folder. 
Concretely, a receiver, a FAX number, date, a 
transmission result, a transmission time, the number of 
trials, a document name, the number of receivers, a 
transmission page, error information, a belonging of a 

25 receiver, a comment, resolution, a compression system, 
a server reception time, a sender, a sender T s PC and 
the like are managed as the log information by the 
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management: server . 

Fig. 24 shows log information of the scanner on 
the network shown in Fig. 1. The log information which 
includes items of user name, scan start time, scan end 
5 time, the number of total scan pages, machine name, 

TWAIN driver name, sheet size, height of sheets, width 
of sheet, color /monochrome and the like is notified to 
the management server, when the job using the scanner 
is executed. Then the notified log information is 

10 managed on the HD of the management server and read 
from the HD according to the log information demand 
from the user of the PC on the network, and the read 
log information is displayed on a display apparatus of 
the PC or the management server of the demand sender. 

15 Fig. 25 shows log information of the printer on 

the network shown in Fig. 1. The log information which 
includes items of user name, printing start time, 
printing end time, the number of total printing pages, 
machine name, printer driver name, application name, 

20 the number of designated prints, preset sheet size, 
non-preset sheet longitudinal size, non-preset sheet 
lateral size, color/monochrome, one face/two faces, 
toner use quantity and the like is notified to the 
management server, when the job using the printer is 

25 executed. Then the notified log information is managed 
on the HD of the management server and read from the HD 
according to the log information demand from the user 
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of the PC on the network, and the read log information 

is displayed on a display apparatus of the PC or the 

management server of the demand sender. 

The toner use quantity data detected or calculated 
5 at the printer side is set as the toner use quantity. 

explanation of data processing procedure> 

Hereinafter, the data processing procedure in the 

data processing apparatus according to the fourth to 

tenth embodiments of the present invention will be 
10 explained. The processing of the later-described 

fourth to seventh embodiments is executed by the CPU 2 

on the basis of a program stored in the HD 10 of Fig. 2 

or a not-shown storage medium. 

[Fourth Embodiment] 
15 Fig. 26 is a view showing relation between the 

data processing apparatus registered as the management 

server and a client device, in the data processing 

apparatus according to the present invention. 

In Fig. 26, numerals 1501, 1510 and 1513 denote 
20 client apparatuses. Numerals 1502, 1511 and 1514 

denote server device information (later-described Fig. 

30), and numerals 1503, 1512 and 1515 denote client 

device information (later-described Fig. 31) which are 

all stored in the HD 10 of Fig. 2. 
25 The server device information 1502 (1511, 1514) is 

composed of information (1. shared device; 2. 

information) of the devices shared on the network and 
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information (3, non-shared device; 4. information) of 
the devices not shared on the network, acquired 
according to the device driver information installed in 
the user's own apparatus, and managed in a client 
5 program in the client apparatus 1501 (1510, 1513). 

Numeral 1504 denotes a management server which 
stores and manages management server device information 

1505 (later-described Fig. 27) in the HD 10 of Fig. 2. 
Numerals 1506 and 1508 denote non-client apparatuses in 

10 which a server program, a client program, programs 
represented by later-described flow charts, and the 
like are not installed. The non-client apparatuses 

1506 and 1508 store device information 1507 and 1509, 
respectively . 

15 The client device information 1503 (1512, 1515) is 

composed of the server device information, the device 
information of the client apparatus effective or 
available on the network, and the device information of 
the non-client apparatus, acquired by the management 

20 server and the non-client apparatus, and managed by the 
client program in the client apparatus 1501 (1510, 
1513) . 

Fig. 27 is a view for explaining the management 
server device information 1505 shown in Fig. 26. 
25 As shown in Fig. 27, the management server device 

information 1505 is composed of header information 
1601, an index table 1602, and device information 
(client PC device information data) 1603-1 to 1603-N of 
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the client apparatuses effective or available on the 
network . 

Each of elements (0) to (N-l) in the index table 
1602 is composed of a data offset, a data size and a 
flag. The elements (0) to (N-l) correspond to the 
device information 1603-1 to 1603-N, respectively. 

Further, each of the device information (client PC 
device information data) 1603-1 to 1603-N of the client 
apparatuses is composed of PC information 1604 (later- 
described Figs. 28A and 28B), printer information 1605 
(later-described Figs. 28A and 28B), scanner 
information 1606 (later-described Figs. 29A and 29B), 
and FAX board information 1607 (later-described Figs. 
29A and 29B). 

Further, the device information 1603-1 to 1603-N 
of the client apparatuses correspond to the information 
(1. shared device; 2. information) of the device shared 
on the network which is acquired from the server device 
information 1502, 1511 and 1514 shown in Fig. 26. 

Fig. 28A is a view for explaining in detail the PC 
information 1604 shown in Fig. 27, and Fig. 28B is a 
view for explaining in detail the printer information 
1605 shown in Fig. 27. 

The PC information 1604 is composed of information 
and content, as shown in Fig. 28A. 

The printer information 1605 is composed of 
information, content and an acquirement method, as 
shown in Fig. 28B. 
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Fig. 29A is a view for explaining in detail -the 
scanner information 1606 shown in Fig. 27, and Fig. 29B 
is a view for explaining in detail the FAX board 
information 1607 shown in Fig. 27. 
5 The scanner information 1606 is composed of 

information, content and an acquirement method, as 
shown in Fig. 29 A. 

The FAX board information 1607 is composed of 
information, content and an acquirement method, as 

10 shown in Fig. 29B. 

Fig. 30 is a view for explaining the server device 
information 1502, 1511, 1514 shown in Fig. 26. In Fig. 
30, it should be noted that the same content as that in 
Fig. 27 is added with same explanation. 

15 in Fig. 30, numeral 1701 denotes local device 

information (or local device information data) which 
represents the devices locally connected with the 
user's own apparatus. The structure of the local 
device information 1701 is the same as that of the 

20 device information 1603-1 to 1603-N of the client 
apparatus shown in Fig. 27. 

As shown in Fig. 30, the server device information 
1502 is composed of the header information 1601, the 
index table 1602 and the local device information 1701. 

25 Fig. 31 is a view for explaining the client device 

information 1503 (1512, 1515) shown in Fig. 26. In 
Fig. 31, it should be noted that the same content as 
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that in Fig. 27 is added with same explanation. 

As shown in Fig. 31, the client device information 
1503 is composed of the header information 1601, the 
index table 1602, the local device information 1701, 
5 the device information (client PC device information 
data) 1603-1 to 1603-N-l of the client apparatuses 
effective or available on the network, the device 
information 1507 of the non-client apparatus 1506, and 
the device information 1509 of the non-client apparatus 
10 1508. 

The structure of the printer information in each 
of the device information 1507 and 1509 of the non- 
client apparatuses 1506 and 1508 is the same of that of 
the printer information 1605 shown in Figs. 28A and 

15 28B. As the printer information, only a shared name 
and a server name are set. 

Fig. 32 is a flow chart showing an example of a 
second data processing procedure in the data processing 
apparatus according to the present invention. The 

20 second data processing procedure corresponds to a 

combination function processing procedure according to 
a system structure display processing. 

First, in a step S301, the domain information to 
which the user ' s own apparatus belongs is acquired, the 

25 address of the management server (either of PC 1 s on the 
network shown in Fig. 1 is registered as the management 
server), and the connection information of all the PC's 
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and the peripheral devices of Fig. 1 shared on the 
network and use conditions and status information of 
these devices are acquired from the management server. 
At this time, also the device information (the 
5 management server device information 1505 shown in Fig. 
26) which has been installed in other PC (i.e., managed 
by the management server) is acquired. The acquired 
information is stored and managed in the PMEM 3 shown 
in Fig. 2. Next, in a step S302, the device 

10 information (the server device information of Fig. 30, 
the information of Fig. 10 or the like) which has been 
installed (managed) in the user's own apparatus is 
checked (acquired). At this time, the device 
information acquired from the management server is 

15 compared with the device information installed in the 
user's own apparatus to specify the device of which 
driver information is not installed in the user's own 
apparatus. 

The management server always monitors the 
20 connection information of all the PC's and the 

peripheral devices of Fig. 1 shared on the network and 
the use conditions and status information of these 
devices. Thus, when status of the PC or the peripheral 
device on the network changes, the management server 
25 notifies latest system information (the connection 
status, the user condition and the status of each 
device on the network) to each client through the LAN's 
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100, 120 and the like. 

In a step S303, the PC's and the peripheral 
devices are displayed on the basis of the acquired 
information. Namely, a system structure status screen 
5 for simultaneously displaying the system structure and 
the system status shown in Fig. 11 is displayed based 
on the client device information shown in Fig. 31. At 
this time, each peripheral device is represented by a 
device name and an inherent icon (i.e., a icon highly 
10 close to the actual appearance of the device body to be 
connected (the icon representing the function including 
monochrome/color information)) specified by the device 
name, on the basis of the acquired information and the 
resource data of the resource data segment 806 of Fig. 
15 18 stored in the HD 10. Such the icon is displayed on 
the CRT 16 together with the connection status and the 
operation status (including the number of currently 
spooled jobs, and visual or numerical information 
representing a unusable status). Also, at this time, 
20 the icon which corresponds to the device not installed 
in the user's own apparatus is displayed in gray. 

Next, in a step S304, when execution of each 
function is instructed, it is judged whether or not 
such an instruction is effective. For example, on the 
25 screen shown in Fig. 11, the scanner icon 303c is 

dragged to and dropped on the digital copying machine 
icon 303 f by using the mouse to execute the copying 
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f unction. 

If judged that the combination is not effective 
(e.g., a combination of the scanner and the scanner, a 
combination of the printer and the printer, or the 
like), the flow advances to a step S305 to display the 
error message as shown in Fig. 8. 

Conversely, if judged in the step S304 that the 
combination is effective (e.g., a combination of the 
scanner and the printer, a combination of the scanner 
and the copying machine, a combination of the scanner 
and the PC, a combination of the scanner and the FAX 
unit, a combination of the PC and the printer, a 
combination of the PC and the PC, a combination of the 
FAX unit and the FAX unit, or the like), the flow 
advances to a step S306 to display a corresponding- 
function window such that the function executable by 
combining the devices can be set as well as the 
function executable by each device. In the present 
embodiment, the virtual operation panels shown in Figs. 
12 to 14 are displayed. 

Next, it is judged in a step S307 whether or not 
the copying is to be performed. When it is instructed 
to stop the copying, the processing ends. Conversely, 
when the button 415 on the virtual operation panels 
shown in Figs. 12 to 14 is depressed to instruct the 
copying, the flow advances to a step S308 to perform 
the copying according to the setting. When the 
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processing is performed, the function window is closed, 
and the displayed content returns to the system 
structure status screen for simultaneously displaying 
the system structure and the system status shown in 
Fig. 11. 

Next, in a step S309, the status that the 
processing is being performed (the copying processing 
is being performed in this case) is image-displayed on 
the screen for simultaneously displaying the system 
structure and the system status shown in Fig, 11. The 
display continues until the processing ends (step S310) 
(see later-described Fig. 33), and the processing ends. 

Fig. 33 is a view showing an example of a copying 
function execution screen of the data processing 
apparatus according to the fourth embodiment of the 
present invention. It should be noted that the same 
parts as those in Fig. 11 are added with same numerals 
and symbols, respectively. 

In Fig. 33, numeral 900 denotes function in» 
execution (i.e., function is being executed) display 
which represents that the image read by the scanner of 
the icon 303c is being printed now by the printer of 
the icon 302f, by displaying the icons 303c and 302f in 
a manner different from other icons and further 
displaying as an image a network path with an arrow of 
fat chain line. When the scanner icon 303c is dragged 
and dropped on the digital copying machine icon 302 f by 
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using the mouse on the operation screens shown in Figs. 
12 to 14 to instruct the copying function execution, 
the function in-execution display 900 continues until 
the copying processing ends. 
5 As above, in order to enable on the screen of the 

CRT 16 the user to visually recognize which device on 
the network the data output source is, which device on 
the network the data output destination is, where on 
the network these devices are disposed, and by what 
10 kind of route the data (image data or the like) flows, 
a displaying form of the icon corresponding to such the 
device is made different from that of other icons to 
emphasize the selected icon. Further, the dotted-line 
arrow as shown in Fig. 33 is displayed on the path 
15 along which the data flows on the network. Thus, the 
arrow is flowingly (or blinkingly) displayed such that 
the data seems to flow or animate from the output 
source to the output destination. 

By the above processing, the device on the network 
20 is displayed with the icon highly close to the actual 
appearance of the device body, the icon representing 
the function including monochrome/color information, 
and the number of currently spooled jobs, whereby it is 
possible to easily select the optimum device on the 
25 network. Besides, after the processing execution for 
the selected device is instructed, the status that the 
processing is being performed is displayed as the image 
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such that the user can grasp the data transfer status 
among the selected input and output devices on the 
network, whereby it is possible to visually confirm the 
used input and output devices and processing end 
5 timing. 

When the PC connected with the network is shut 
down, this PC notifies the management server of such 
shutdown. The management server judges whether or not 
there is other user who has selected the device 

10 connected with this PC. If there is the user who has 
selected the device connected with this PC or already 
started the processing by the device connected with 
this PC, a message "There is a user who has selected or 
uses the device connected with this computer. If you 

15 shut down this computer, the selection or use of such 
the device by that user is forcedly released or ended. 
Do you shut down this computer?" is transmitted to this 
PC. Thus, the shutdown of the PC from which the 
shutdown is demanded is temporarily reserved. 

20 Thus, when the device connected with other PC has 

been selected, or when the processing by the device 
connected with other PC was already started, it is 
possible to prevent that, by the PC shutdown, the 
selection of such the device is released or the 

25 processing by such the device is forcedly ended. For 
example, in Fig. 33, even if the PC of the icon 302 j 
connected with the scanner of the icon 303c notifies 
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the management server of the shutdown through the 
network, the management server returns the above- 
described message to the PC of the icon 302j so as to 
cause this PC to temporarily reserve the shutdown at 
5 least until the current job ends. 
[Fifth Embodiment] 

Fig. 34 is a flow chart showing an example of a 
third data processing procedure in the data processing 
apparatus according to the present invention. The 

10 third data processing procedure corresponds to display 
processing procedure on the virtual operation panels 
shown in Figs. 12 to 14. For example, when the scanner 
icon 303c is dragged and dropped on the digital copying 
machine icon 302f and thus the copying function is 

15 executed, the third data processing procedure is 
executed in the step S306 of Fig. 32. 

First, in a step S401, the information of the 
selected input and output devices is acquired from the 
device driver information (e.g., the device driver 

20 information of Fig. 10) stored and managed in the 

user's own apparatus, the resource file of Fig. 18, and 
the like. 

Concretely, on the basis of the device driver 
information of Fig. 10, the resource file of Fig. 18 
25 and the like, the resource data (corresponding to the 

icons 403a and 404a respectively representing the input 
and output devices of Figs. 12 to 14) of the inherent 
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icons corresponding to the selected input and output 
devices (i.e., the icons (the icons representing the 
functions including monochrome and color information) 
extremely close to the appearances of the connected 
5 bodies) and the resource data (corresponding to the 

system image MFI of Figs. 12 to 14) of the system image 
MFI (including each option device image) corresponding 
to the selected output device are acquired. 

Next, the virtual operation panels shown in Figs. 
10 12 to 14 are displayed on the CRT 16 in a step S402, 
the icons 403a and 404a respectively representing the 
input and output devices corresponding to the selected 
input and output devices are displayed on the virtual 
operation panel in a step S403, and the system image 
15 MFI corresponding to the output device is displayed in 
a step S404. This system image MFI is the structure 
image which includes an expansion function capable of 
being set by the output device, i.e., the structure 
image of the output device which includes option 
20 devices (a finisher, a sorter, a paper deck, etc.) 

optionally installed in the output device. Here, in 
addition to the structure image concerning the output 
device, the structure image which includes an expansion 
function capable of being set by the input device, 
25 i.e., the structure image of the input device which 

includes an option device optionally installed in the 
input device (e.g., the ADF optionally installed in the 
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scanner) may be displayed. 

Next, in a step S405, the setting function button 
layout information which has been previously set on the 
editing window 850 of Fig. 19 and stored in the HD 10 
5 or the like of Fig. 2 is acquired. Then, in a step 

S406, the selectable function buttons (the buttons Bl 
to B8 of Figs. 12 to 14) are displayed on the virtual 
operation panel, on the basis of the setting function 
button layout information. 

10 Next, in a step S407, on the basis of the input 

device performance and the output device performance, 
optimum input and output settings (monochrome/color, 
density, an image style (resolution), and a sheet size) 
is determined. 

15 For example, when both the input and output 

devices can cope with color processing, the color is 
determined as the monochrome/color setting. 
Conversely, when either one of the input and output 
devices can cope with only monochrome processing, the 

20 monochrome is determined. Half the resolution of the 
resolution of the output device is determined as the 
resolution setting. The sheet size is determined based 
on, e.g., the image size and the sheet size capable of 
being managed by the selected scanner and printer (A4 

25 size for both the input and output images in this 
case) . 

Next, in a step S408, the optimum input and output 
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settings are displayed as default values on the virtual 
operation panel (the slider 409 for performing the 
density setting of Figs. 12 to 14, the slider 410 for 
setting the image style, the color mode of the input 
5 image, and the sheet size are set and displayed in the 
area 406), and the processing ends. Although it is not 
displayed here (i.e., it is displayed according to the 
indications by the icons 403 and 404a of the input and 
output devices ) , the determine optimum input and output 

10 settings are set and displayed on the property screen 
830 shown in Fig. 17. 

By the above processing, since the icons highly 
close to the appearances of the bodies of the selected 
input and output devices and the function including the 

15 monochrome/ color information and the like are displayed 
on the virtual operation panel, the user can visually 
recognize the kinds and functions of the selected input 
and output devices . 

Further, since the optimum input and output 

20 settings of the selected input and output devices are 
displayed as default values, even the user who is 
unfamiliar with the input and output settings (the 
monochrome/color, the density, the image style 
(resolution), and the sheet size) can easily output the 

25 high-quality image suitable for the performances of the 
input and output devices. 

Further, the user can perform the input and output 
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settings in detail by using the detail setting screen 
(e.g., the property screen shown in Fig. 17) displayed 
according to the indications by the icons 403a and 404a 
respectively representing the input and output devices. 
5 Further , since the system image which includes the 

option device installation status of the selected 
output device is displayed on the virtual operation 
panel, the user can visually recognize the option 
device installation statuses of the selected input and 

10 output devices. Thus, even the user who does not know 
the option device installation status of the selected 
output device can easily perform the option setting. 

Further, since the function buttons (the buttons 
Bl to B8 of Figs. 12 to 14) can be previously edited 

15 (i.e., arrangement order setting, and display/non- 
display setting) on the editing window 850 of Fig. 19, 
thereby further improving operability for function 
setting . 

Since the resource file and the resource data of 
20 the icon of each device shown in Fig. 18 are 

transmitted from the management server to each device 
through the network path every time the data is 
updated, the resource of the latest option can be 
always provided. Even if a new device (including an 
25 option device) is manufactured and added by a maker, it 
is possible by only installing the resource file into 
the management server, to display the icon (system 
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image) corresponding to the new device (including the 
option device) on all client machines (PC ? s) on the 
network without performing complicated operations to 
install the resource file into all the client machines 
5 (PC's). 

[Sixth Embodiment] 

Fig. 35 is a flow chart showing an example of a 
fourth data processing procedure in the data processing 
apparatus according to the present invention. The 

10 fourth data processing procedure corresponds to 

processing which is performed in the step S308 of Fig. 
32, for example, when the scanner icon 303c is dragged 
and dropped on the digital copying machine icon 302f 
and thus the copying function is executed. 

15 First, in a step S501, the image is input from the 

input device according to the setting on the virtual 
operation panels shown in Figs. 12 to 14. In the 
present embodiment, the image is actually input from 
the scanner corresponding to the icon 303c. 

20 Next, in a step S502, it is judged whether or not 

the image processing (i.e., two kinds of image 
processing (the effect processing and the stamp 
processing) called the amusement setting in the present 
embodiment) on the PC side has been set by the button 

25 B7 of Figs. 12 to 14 and on the setting screen of Figs. 
15 and 16. If judged that the image processing on the 
PC side has been set, the flow advances to a step S503 
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to cause the PC to perform the image processing (the 
effect processing, the stamp processing, etc.) to the 
image input in the step S501 on the basis of the 
setting of Figs. 15 and 16, and the flow advances to a 
5 step S504. 

Conversely, if judged in the step S502 that the 
image processing on the PC side has been set by the 
button B7 of Figs. 12 to 14 and on the setting screen 
of Figs. 15 and 16, the flow advances to the step S504 

10 as it is. 

Next, in the step S504, an output job of output 
format (including processing page layout depending on 
the output device, two-face printing, stapling or the 
like) based on the input and output settings on the 

15 virtual operation panel is generated, and the generated 
output job is transmitted to the output device (the 
digital copying machine corresponding to the icon 302 f 
in the present embodiment) in a step S505. In this 
case, the output job data (including the command to 

20 instruct the processing (the page layout, the two-face 
printing, the stapling, etc.) to be performed on the 
output device side) is transmitted together with the 
input image (or the image processed on the PC side when 
the image is processing on the PC side). Then the 

25 processing ends. It should be noted that the 

processing in the steps S502 to S505 is performed every 
time the data corresponding to output one page is 
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input . 

By the above processing , after the image input by 
using the input device is subjected to the image 
processing by the user on the basis of the application 
5 on the PC, the conventional complicated processing to 

output the processed image by using the function of the 
output device is unnecessary. Namely, after the input 
and output devices are selected by the drag and drop 
operations, the image subjected to the PC-side 

10 processing undependent on the output device in addition 
to the output-device-side image processing can be 
output from the output device by simply setting the PC- 
side processing and the output-device-side processing 
on the virtual operation panel. 

15 [Seventh Embodiment] 

In the above embodiment, the case where the 
printing processing by the output device is performed 
based on the setting on the virtual operation panels 
shown in Figs. 12 to 14 was explained. However, when 

20 the printing processing is performed, it is possible to 
acquire resource information (a sheet remaining 
quantity, a toner remaining quantity, a staple 
remaining quantity, etc. ) of the output device to judge 
whether or not the printing processing can be 

25 performed, and notify the user of the judged result. 

Hereinafter, the seventh embodiment will be explained. 
Fig. 36 is a view showing an example of a warning 
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message displayed on the CRT 16 shown in Fig. 2. For 
example, in the case where the button 415 on the 
virtual operation panels of Figs. 12 to 14 is depressed 
by the user to instruct the copying execution, when the 
5 number of sheets held in the output device is smaller 
than the number of sheets necessary for the instructed 
printing processing, the warning message is displayed 
before the printing processing is actually performed. 
In Fig. 36, numeral 901 denotes the warning 
10 message. For example, in the case where the button 415 
on the virtual operation panels of Figs. 12 to 14 is 
depressed to instruct the copying execution, when it is 
anticipated that the number of sheets held in the 
output device is smaller than the number of sheets 
15 necessary for the instructed printing processing, the 
warning message 901 is displayed on the CRT 16 before 
the printing processing is actually performed. 

Numeral 902 denotes a button. When the button 902 
is depressed, the printing processing in the selected 
20 output format is stopped. Instead, a selection screen 
of other output format (i.e., a selection window of 
output format shown in later-described Fig. 37) which 
can output the image is displayed. 

Numeral 903 denotes a cancel button. When the 
25 cancel button 903 is depressed, the printing processing 
is stopped, and the displayed content returns to the 
setting screen, e.g., the virtual operation panels 
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shown in Figs. 12 to 14. 

Numeral 904 denotes a continuation button. When 
the continuation button 904 is depressed, the printing 
processing is continued (or forcedly performed). 
5 Fig. 37 is a view showing an example of an output 

format selection window displayed on the CRT 16 shown 
in Fig. 2. 

In Fig. 37 , numeral 1001 denotes the output format 
selection window which is displayed when the button 902 

10 of Fig. 36 is depressed. In the window 1001, other 
output formats capable of performing image output 
(e.g., 2-in-l printing, two-face printing, etc.) in the 
number of sheets held in the output device are listed 
and displayed in a selectable manner. 

15 Numeral 1002 denotes an execution button. When 

the execution button 1002 is depressed, the printing 
processing is performed in the selected other output 
format. Numeral 1003 denotes a processing stop button. 
When the processing stop button 1003 is depressed, the 

20 displayed content returns to the setting screen, e.g., 
the virtual operation panels shown in Figs. 12 to 14. 

Fig. 38 is a flow chart showing an example of a 
fifth data processing procedure in the data processing 
apparatus according to the present invention. The 

25 fifth data processing procedure is performed when the 

functions (the copying function, the printing function, 
etc. ) to perform the printing processing by using the 
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output device (i.e., the printer) is executed. 

When it is judged that the printing processing is 
performed, sheet number information (representing the 
number of sheets) is acquired from the indicated 
5 printer in a step S601. 

Next, in a step S602, it is judged based on the 
acquired sheet number information whether or not the 
number of sheets capable of performing the instructed 
(e.g., designated on the virtual operation panels of 

10 Figs. 12 to 14) printing processing has been held in 
the printer (i.e., whether or not a processing 
condition is satisfied). If judged that the processing 
condition is satisfied, the flow advances to a step 
S603 to perform the printing processing. 

15 Conversely, if judged in the step S602 that the 

number of sheets capable of performing the instructed 
(e.g., designated on the virtual operation panels of 
Figs. 12 to 14) printing processing is not held in the 
printer (i.e., the processing condition is not 

20 satisfied), the flow advances to a step S604 to display 
the warning message 901 shown in Fig. 36. 

Next, in a step S605, it is judged whether the 
user depresses the button 902 shown in Fig. 36 (i.e., 
instructs the display of other processible output 

25 format), depresses the cancel button 903 (i.e., 

instructs the print processing stop), or depresses the 
continuation button 904 (i.e., instructs the 
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continuation of the printing processing). 

If judged that the user instructs the printing 
processing stop, the printing processing ends. 

If judged in the step S605 that the user instructs 
5 the continuation of the printing processing, the flow 
advances to the step S603 to perform the printing 
processing . 

Further, if judged in the step S605 that the user 
instructs the display of other processible output 

10 format, the flow advances to a step S606 to acquire 

other output format capable of performing the printing 
processing instructed from the virtual operation panel 
or the like, on the basis of printer information 
previously acquired from a printer driver, the sheet 

15 number information acquired in the step S601, and the 
like. Then, in a step S607, the output format 
selection window 1001 of Fig. 37 which shows other 
output format capable of performing the instructed 
printing processing is displayed. 

20 Next, in a step S608, it is judged whether the 

user depresses the execution button 1002 shown in Fig. 
37 (i.e., instructs the change of output format), or 
depresses the processing stop button 1003 (i.e., 
instructs the printing processing stop). 

25 If judged that the user instructs the printing 

processing stop, the printing processing ends. 

Conversely, if judged in the step S608 that the 
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user instructs the change of output format, the flow 
advances to a step S609 to perform the printing 
processing in the instructed output format, i.e., the 
output format selected in the output format selection 
5 window 1001 of Fig. 37, and the processing ends. 

By the above processing, when it is anticipated 
that the number of sheets becomes insufficient during 
the printing, the warning message is displayed. Thus, 
it is possible to prevent that the number of sheets 
10 becomes insufficient during the printing beforehand, 
whereby the user can refill the sheets to the output 
device before the actual processing is started. 

In the present embodiment (especially the steps 
S601 and S602 of Fig. 38), the case where the sheet 
15 number information is acquired from the designated 

printer, and then it is judged based on the acquired 
sheet number information whether or not the sheets of 
which number is sufficient to perform the instructed 
printing processing have been held was explained. 
20 However, it is possible to acquire the sheet number 
information of the designated printer and the sheet 
number information used in the spooled job in the step 
S601 of Fig. 38, and to judge based on the acquired 
sheet number information whether or not the sheets of 
25 which number is sufficient to perform the instructed 

printing processing have been held in consideration of 
the sheet information used in the spooled job. In this 
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case, a message "This sheet has been preserved for 
printing," can be additionally displayed. 

Thus, it is possible to accurately anticipate that 
the sheets become insufficient during the printing 
5 processing, in consideration of the spooled job. 

Further, it is possible to notify the user of 
other output format (e.g., the two-face printing, the 
2-in-l printing, or the like) capable of performing the 
printing processing designated by the user, and to 
10 perform the selection on the screen notified, whereby 
the complicated operation that the displayed content 
must return to the setting screen every time the output 
format is changed is unnecessary. Thus, even the user 
who is unfamiliar with the operation can easily change 
15 the output format to other output format. Besides, it 
is possible to perform the instructed printing 
processing (i.e., it is possible to perform substitute 
printing) without refilling sheets to the printer. 

In the present embodiment, the case where, in case 
20 of performing the printing, the sheet remaining 

quantity in the output device is acquired and it is 
judged based on the acquired information whether or not 
the printing processing can be performed was explained. 
Besides, when stapling processing has been set to the 
25 designated printing processing, it is possible to 
acquire staple remaining information of the output 
device, judge based on the acquired information whether 
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or not the printing processing can be performed, and 
notify the user of such a warning message as shown in 
Fig. 36 if the printing processing can not be 
performed, 

5 Even in this case, the user can instruct the 

change of output format. Namely, in an output format 
selection window such as the window 1001 shown in Fig. 
37, it is possible to select other output format (e.g., 
single-staple sort processing or non-staple sort 
10 processing by which the number of used staples can be 
reduced) capable of performing the instructed printing 
processing. Thus, the user can change the output 
format and perform the printing processing. 

By the above processing, when it is anticipated 
15 that the number of staples becomes insufficient during 
the printing, the warning message is displayed. Thus, 
it is possible to prevent that the number of staples 
becomes insufficient during the printing beforehand, 
whereby the user can refill the staples to the output 
20 device before the actual processing is started. 

Further, , it is possible to notify the user of 
other output format (e.g., single-staple sort 
processing, two-face printing sort processing, 2-in-l 
sort processing or non-staple sort processing by which 
25 the number of used staples can be reduced (i.e., by 

which stapling can be easily performed in later manual 
stapling)) capable of performing the staple-added 
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printing processing, and to perform the selection on 
the screen notified, whereby the complicated operation 
that the displayed content must return to the setting 
screen every time the output format is changed is 
5 unnecessary. Thus, even the user who is unfamiliar 

with the operation can easily change the output format 
to other output format. Besides, it is possible to 
perform the instructed printing processing (i.e., it is 
possible to perform substitute processing) without 

10 refilling the staples to the printer. 

Further, it is possible to acquire the staple 
information from the designated printer and the 
information of the staple used in the spooled job, and 
to judge based on the acquired staple information 

15 whether or not the staples of which number is 
sufficient to perform the instructed printing 
processing have been held in the printer, in 
consideration of the staples used in the spooled job. 

Thus, it is possible to accurately anticipate that 

20 the staples become insufficient during the printing 
processing, in consideration of the spooled job. 
[Eighth Embodiment] 

In the above seventh embodiment, the case where, 
in case of performing the printing, the resource 

25 information (i.e., the sheet remaining information, and 
the staple remaining information) or the like of the 
output device is acquired, it is judged based on the 
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acquired information whether or not: the printing 
processing can be performed, and the judged result is 
notified to the user was explained . Besides, in case 
of performing the printing, it is possible to acquire 
5 resource information (i.e., toner remaining 

information) or the like of the output device, judge 
based on the acquired information whether or not the 
printing processing can be performed, and notify the 
user of the judged result. Hereinafter, the eighth 

10 embodiment will be explained. 

Fig. 39 is a view showing an example of the 
warning message displayed on the CRT 16 shown in Fig. 
2. For example, in the case where the button 415 on 
the virtual operation panels of Figs. 12 to 14 is 

15 depressed to instruct the copying execution, when the 
remaining quantity of the toner held in the output 
device is smaller than the toner quantity necessary for 
the instructed printing processing, the warning message 
is displayed before the printing processing is actually 

20 performed. 

In Fig. 39, numeral 1101 denotes the warning 
message. For example, in the case where the button 415 
on the virtual operation panels of Figs. 12 to 14 is 
depressed to instruct the copying execution, when it is 

25 anticipated that the remaining quantity of the toner 
held in the output device is smaller than the toner 
quantity necessary for the instructed printing 
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processing, the warning message 1101 is displayed 
before the printing processing is actually performed. 

It should be noted that the warning message 1101 
is displayed for the toners of all the colors to which 
5 insufficiency is anticipated. For example, when it is 
anticipated that black toner and cyan toner become 
insufficient, the message "There is a possibility where 
black toner and cyan toner are insufficient. Confirm 
(and fill) black and cyan toner quantities, and again 
10 perform proc. " is displayed. 

Numeral 1102 denotes an OK button. When the OK 
button 1102 is depressed, the printing processing ends, 
and the displayed content returns to the setting 
screen, e.g., the virtual operation panels shown in 
15 Figs. 12 to 14. 

Numeral 1103 denotes a continuation button. When 
the continuation button 1103 is depressed, the printing 
processing is continued (or forcedly performed). 

Fig. 40 is a flow chart showing an example of a 
20 sixth data processing procedure in the data processing 
apparatus according to the present invention. 

Initially, in a step S701, the domain information 
to which the user's own apparatus belongs is acquired. 
Next, in a step S702, the address of the management 
25 server (either of the PC f s on the network shown in Fig. 
1 is registered as the management server) is acquired. 

Next, in a step S703, it is judged whether or not 
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the processing (e.g., the copying processing, the 
printing processing or the like) to access the printer 
is performed. If judged that the processing to access 
the printer is not performed, the processing ends as it 
5 is . 

Conversely, if judged in the step S703 that the 
processing to access the printer is performed, the flow 
advances to a step S704 to acquire the indicated 
printer log (either of the printer log information 

10 segments 872-1 to 872-M in the printer log management 
information shown in Fig. 21). Concretely, the 
information as to which printer the access is performed 
(i.e., the information as to the designated printer) is 
notified to the management server, and the management 

15 server returns to the client machine (PC) the printer 
log information segment (log information) of the 
corresponding printer selected from among the printer 
log information segments 872-1 to 872-M in the printer 
log management information shown in Fig. 21. 

20 Next, in a step S705, the toner information (i.e., 

the toner remaining quantity) or the like is acquired 
from the designated printer. 

Next, in a step S706, it is judged whether or not 
the instructed processing satisfies a necessary 

25 condition, on the basis of the log information acquired 
in the step S704 and the printer toner information 
acquired in the step S705. Concretely, the log 
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information acquired from the management server is 
analyzed, the toner use quantity in case of performing 
processing same as the currently designated processing 
(i.e., the processing judged to be the same as the 
5 currently designated processing on the basis of a kind 
of application, a kind of scanner (high speed scanner, 
low speed scanner, color scanner, or monochrome 
scanner), the number of total printing pages, sheet 
size, color /monochrome, one face/two faces, etc. ) is 

10 calculated (anticipated), and the anticipated toner 
user quantity is compared with the toner remaining 
quantity acquired from the printer, thereby judging 
whether or the not the instructed processing satisfies 
the necessary condition (i.e., judging whether or not 

15 the processing can be performed). 

If judged in the step S706 that the instructed 
processing satisfies the necessary condition on the 
basis of the log information and the printer toner 
information, the flow advances to a step S710 to 

20 perform the instructed processing. Thus, the toner 

information is acquired from the printer, and the log 
information (printer name, input information, the 
number of total printing pages, sheet size, 
color /monochrome, one face/ two faces, toner use 

25 quantity (for each color), etc.) is generated based on 
the acquired toner information. 

Next, in a step S711, the generated toner 
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information (printer name, input information, the 
number of total printing pages, sheet size, 
color /monochrome, one face/two faces, toner use 
quantity (for each color), etc.) is registered in the 
5 management server, and the processing ends* 

Conversely, if judged in the step S706 that the 
instructed processing does not satisfy the necessary 
condition on the basis of the log information and the 
printer toner information, the flow advances to a step 

10 S707 to display the warning message shown in Fig. 39. 

Then, in a step S708, it is judged whether or not the 
processing is instructed to be continued as it is 
(i.e., it is judged whether or not the continuation 
button 1103 is depressed). 

15 If judged in the step S708 that the processing is 

instructed to be continued as it is, the flow advances 
to a step S709 to continue the processing. Thus, the 
toner information is acquired from the printer, the log 
information (printer name, input information, the 

20 number of total printing pages, sheet size, 

color /monochrome, one face/ two faces, toner use 
quantity (for each color), etc.) is generated based on 
the acquired toner information, and the flow then 
advances to the step S711. 

25 Conversely, if judged in the step S708 that the 

processing is instructed not to be continued (i.e., 
judged that the OK button 1102 is depressed), the 
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processing ends . 

By the above processing, when it is anticipated 
that the toner becomes insufficient during the 
printing, the warning message is displayed. Thus, it 
5 is possible to prevent that the toner becomes 

insufficient during the printing beforehand, whereby 
the user can refill the toner to the output device 
before the actual processing is started. 

Further, it is possible to notify the user of 

10 other output format (e.g., economy-mode printing of 

which toner use quantity is small, monochrome printing, 
2-in-l printing, etc.) capable of performing the 
instructed printing processing with use of the 
selection window same as the output format selection 

15 window 1001 shown in Fig. 37, and to perform the 
selection on the screen notified, whereby the 
complicated operation that the displayed content must 
return to the setting screen every time the output 
format is changed is unnecessary. Thus, even the user 

20 who is unfamiliar with the operation can easily change 
the output format to other output format. Besides, it 
is possible to perform the instructed printing 
processing (i.e., it is possible to perform substitute 
processing) without refilling the toner to the printer. 

25 Further, if judged that the instructed processing 

does not satisfy the necessary condition, it is 
possible to notify the user of other printer capable of 
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performing the user-instructed printing processing with 
use of the selection window same as the output format 
selection window 1001 shown in Fig. 37, and to perform 
the selection on the screen notified, whereby the 
5 complicated operation that the displayed content must 
return to the setting screen every time the output 
format is changed is unnecessary. Thus, even the user 
who is unfamiliar with the operation can easily change 
the used printer to other printer. Besides, it is 

10 possible to perform the instructed printing processing 
without refilling the toner to the printer. 

Further, for example, when it must wait for one 
executable job for a long time to execute because of a 
spooled other job, it is possible to acquire an end 

15 anticipation time of the spooled other job from the 
printer when accessing this printer, and then notify 
the warning message as to the end anticipation time. 

In the present embodiment, the case where, in case 
of performing the printing, the toner remaining 

20 quantity or the like of the output device is acquired, 
it is judged based on the acquired information whether 
or not the printing processing can be performed, and 
the judged result is notified to the user was 
explained. However, the checked target is not limited 

25 to the toner. Namely, ink, an ink ribbon or the like 
may be checked . 

Further, in the present embodiment, the case 
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where, in case of performing the printing processing, 
the printer log is acquired from the management server 
through the network and the resource information (the 
toner remaining quantity) is acquired from the printer, 
and it is judged based on the acquired information 
whether or not the printing processing can be performed 
was explained. However, in a case where a stand-alone 
PC ends the printing processing to the printer 
connected with the PC itself, it is possible to once 
store a printer log in the PC T s own HD or the like, 
acquire the stored printer log and the printer resource 
information (the toner remaining quantity) from the 
connected printer, and judge based on the acquired 
information whether or not the printing processing can 
be performed . 

Thus, even in the printer which is connected with 
the stand-alone PC, it is possible to prevent that the 
toner becomes insufficient during the printing 
beforehand, whereby the user can refill the toner to 
the output device before the actual processing is 
started. 

[ Ninth Embodiment ] 

in the above eighth embodiment, the case where, in 
case of performing the printing processing, the printer 
log is acquired from the management server and the 
resource information (the toner remaining quantity) is 
acquired from the printer, it is judged based on the 
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acquired information whether or not the printing 
processing can be performed, and the judged result is 
notified to the user was explained. However, it is 
possible based on a user's instruction to acquire the 
5 log information for each processing (printing 

processing, FAX transmission/reception processing, 
image reading processing, etc. ) managed by the 
management server, and display the acquired log 
information. Hereinafter, the present embodiment will 
10 be explained. 

Fig. 41 is a flow chart showing an example of a 
seventh data processing procedure in the data 
processing apparatus according to the present 
invention . 

15 Initially, in a step S801, the domain information 

to which the user's own apparatus belongs is acquired. 
Next, in a step S802, the address of the management 
server (either of the PC T s on the network shown in Fig. 
1 is registered as the management server) is acquired. 

20 Next, in a step S803, it is judged whether or not 

display of the log information is instructed (e.g., it 
is possible to instruct the display for each of the 
printing function, the FAX transmission/reception 
function, the image reading function, etc.). If judged 

25 that the log information display is not instructed, the 
flow advances to a step S806. 

Conversely, if judged in the step S803 that the 



log information display is instructed, the flow 
advances to a step S804 to acquire the log information 
of the indicated function (Figs. 22 to 25) from the 
management server, and the flow further advances to a 
step S805 to display the acquired information in a 
user's desired form (list display, graph display or the 
like). It should be noted that this display form is 
indicated when the log information display is 
instructed . 

Next, in the step S806, it is judged whether or 
not display of bind information is instructed (e.g., it 
is possible to instruct the display for each of the 
copying function and the FAX transmission/reception 
function). If judged that the bind information display 
is not instructed, the flow advances to a step S809 . 

Conversely, if judged in the step S806 that the 
bind information display is instructed, the flow 
advances to a step S807 to acquire the bind information 
of the indicated function (Fig. 20) from the management 
server, and the flow further advances to a step S808 to 
display the acquired information in the user's desired 
form (list display, graph display or the like). It 
should be noted that this display form is indicated 
when the bind information display is instructed. 

Next, in the step S809, it is judged whether or 
not display of a network traffic quantity is 
instructed. If judged that the network traffic 
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quantity display is not instructed, the processing ends 
as it is. 

Conversely , if judged in the step S809 that the 
network traffic quantity display is instructed, the 
5 flow advances to a step S810 to acquire network traffic 
quantity information (not shown) from the management 
server, and the flow further advances to a step S811 to 
display the acquired information in the user's desired 
form (list display, graph display or the like). It 
10 should be noted that this display form is indicated 
when the network traffic quantity display is 
instructed. 

By the above processing, it is possible to easily 
grasp the device combination information ( bind 
15 information), a use frequency, a use time and the like 
for each function. For example, it is possible to 
easily grasp the combination of the scanner and the 
printer in case of the copying function. 

It should be noted that, as each log information, 
20 the processing information is notified from the client 
machine (PC) to the management server every time each 
function is executed. 

Further, it should be noted that the network 
traffic quantity is always monitored by the management 
25 server. 

[ Tenth Embodiment ] 

In the above first to ninth embodiments, the case 



- 94 - 



where the icons of the virtually displayed scanner and 
printer or the icons of the virtually displayed scanner 
and multifunctional device are dragged and dropped, and 
thus the function processing to print the image of one 
5 document input from one scanner with use of the 

printer, the multifunctional device and the like was 
explained. However, it is possible to combine the 
image of one document input from the scanner with the 
images of the documents of the data files stored in the 

10 user's own apparatus and other PC on the network, and 

output the combined images. Besides, it is possible to 
combine (i.e., bind) the image data of the plural 
documents input from the two scanners with others, and 
output the combined images. Hereinafter, the tenth 

15 embodiment will be explained. 

Fig. 42 is a view showing an example of a virtual 
operation panel displayed on the CRT 16 of the data 
processing apparatus shown in Fig. 2. When the scanner 
icon dragged in the status that the icon 302f of Fig. 

20 11 is effectively displayed is dropped on the icon 

302f, the virtual operation panel is displayed on the 
CRT 16 as the image by which the digital copying 
machine 118 and the option devices connected thereto 
can be confirmed, by referring to the device driver 

25 information acquired from the digital copying machine 
118 corresponding to the icon 302f and managed on the 
HD 10 or the PMEM 3. It should be noted that the same 
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parts as those in Fig. 12 are added with same numerals 
and symbols, respectively. 

In Fig. 42, numeral 1201 denotes a combination 
document file designation area in which the document 
5 file (a document file, an image file or the like stored 
as a shared file in the user's own apparatus or other 
PC) to be combined with the image of one document input 
from the input device corresponding to the icon 403a is 
designated. When there is no designation, a message 

10 "none" is displayed in the combination document file 
designation area 1201, and the image input from the 
input device of the icon 403a and the file are not 
combined with each other. Numeral 1201a denotes a 
button. When the button 1201a is depressed, the 

15 combination document file selection window shown in 
later-described Fig. 43 is displayed. 

Numeral 1202 denotes a combination image data 
designation area in which other input device for 
inputting the image data to be combined with the image 

20 input from the input device corresponding to the icon 
403a is designated. When there is no designation, a 
message "none" is displayed in the combination image 
data designation area 1202, and the image input from 
the input device of the icon 403a and the file are not 

25 combined with each other. Numeral 1202a denotes a 
button. When the button 1202a is depressed, the 
combination image data selection window shown in later- 
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described Fig, 44 is displayed. 

Numeral 1203 denotes an output order display area 
which includes an icon (a combination document 1203a) 
representing the file designated in the combination 
5 document file designation area 1201, an icon (an image 
1203b) representing the image input from the input 
device corresponding to the icon 403a, and an icon (a 
combination image 1203c) representing the image input 
from the input device designated in the combination 

10 image data designation area 1202. The combination 
document 1203a, the image 1203b and the combination 
image 1203c are output in the displayed order (i.e., 
from the left in due order). Namely, the image input 
from the input device corresponding to the icon 403a is 

15 combined with the image of the file designated in the 
combination document file designation area 1201, and 
the image input from the input device designated in the 
combination image data designation area 1202 is 
serially combined with the above combined image, 

20 whereby the three documents are collected into one 
document and output . 

The output order of the combination document 
1203a, the image 1203b and the combination image 1203c 
in the output order display area 1203 can be changed 

25 by, e.g., the drag operation of the mouse 13 shown in 
Fig. 2. 

The combination document 1203a and the combination 
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image 1203c are not displayed when there is no 
designation in the combination document file 
designation area 1201 and the combination image data 
designation area 1202. 
5 For example, when the scanner icon dragged in the 

status that the icon 302f of Fig. 11 is effectively 
displayed is dropped on the icon 302f , the virtual 
operation panel as shown in Fig. 42 is displayed. At 
this time, only the icon of the image 1203b (i.e., the 

10 icon representing the image input from the scanner 

corresponding to the dragged scanner icon) is displayed 
in the output order display area 1203. When the file 
is designated in the combination document file 
designation area 1201, the icon of the combination 

15 document 1203a is displayed at the right of the image 
1203b. Subsequently, when the input device is 
designated in the combination image data designation 
area 1202, the icon of the combination image 1203c is 
displayed at the right of the icon of the combination 

20 document 1203a. Then, when the copying start button 
415 is depressed, the documents corresponding to the 
icons displayed in the area 1203 are sequentially 
output and image formed as one document in the order 
displayed in the area 1203 (i.e., in the order of the 

25 image 1203b, the combination document 1203a and the 
combination image 1203c in this case). 

Fig. 43 is a view showing an example of the 
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combination document selection window displayed 
according to icon instructions corresponding to the 
button 1201a displayed on the virtual operation panel 
of the CRT 16 of the data processing apparatus shown in 
5 Fig. 2. 

In Fig. 43, numeral 1300 denotes a combination 
document selection window which displays files (a 
document 1, a document 2 and an image 1 ) in a directory 
preset as a combination document directory. Here, the 

10 documents 1 and 3 represent the document files, and the 
image 1 represents the image file. When the user 
selects either of the document 1, the document 2 and 
the image 1 by using the mouse 13 or the like, the 
combination document selection window 1300 is closed, 

15 and the full path of the selected file is displayed in 
the combination image data designation area 1201 of 
Fig. 42. 

When, in a file 1301, a selectable item "change of 
combination document directory" in a not-shown menu 

20 displayed based on an instruction of the mouse 13 or 
the like is selected, the combination document 
directory can be changed. Further, in the file 1301, 
when a selectable item "reference to network" in the 
not- shown menu displayed based on an instruction of the 

25 mouse 13 or the like is selected, the system structure 
status screen of Fig. 11 is displayed, whereby it is 
possible to select the shared file on other PC. 
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Fig. 44 is a view showing an example of the 
combination image data selection window displayed 
according as the button 1202a displayed on the virtual 
operation panel of Fig. 42 is depressed. 
5 In Fig. 44, numeral 1400 denotes the combination 

image data selection window* Input device names shared 
in the network are displayed in a selection display 
area 1401. Numeral 1402 denotes a selection button. 
When the selection button 1402 is depressed after 
10 either of the input devices displayed in the selection 
display area 1401 is indicated by using the mouse 13 or 
the like, the combination image data selection window 

1400 is closed, and the name of the selected input 
device is displayed in the combination image data 

15 designation area 1202 of Fig. 42. Numeral 1403 denotes 
a cancel button. When the cancel button 1403 is 
depressed, the selection in the selection display area. 

1401 is cancelled, and the combination image data 
selection window 1400 is then closed. 

20 Numeral 1404 denotes a reference menu. When the 

reference menu 1404 is indicated by using the mouse 13 
or the like, the system structure status screen shown 
in Fig. 11 is displayed, whereby it is possible to 
select the input device on this screen. 

25 In the status that the system structure status 

screen shown in Fig. 11 is displayed, when 
predetermined keys, e.g., " CTRL" and "ALT" keys of the 
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keyboard 12 are simultaneously depressed, the shape of 
the icon corresponding to the input device having the 
same function as that of the input device already 
selected (i.e., the input device corresponding to the 
5 icon 403a of Fig. 42) can be changed and displayed 
(e.g. , winked) . 

Further, on the system structure status screen 
shown in Fig. 11, in order to prevent that the already- 
selected input device (i.e., the input device 

10 corresponding to the icon 403a of Fig. 42) is selected 
doubly, the icon of the already- selected input device 
may be displayed, e.g., in gray such that the user can 
not select such the device. 

Fig. 45 is a flow chart showing an example of an 

15 eighth data processing procedure in the data processing 
apparatus according to the present invention. The 
eighth data processing procedure corresponds to 
processing which is performed in the step S308 of Fig. 
32, for example, when the scanner icon 303c is dragged 

20 and dropped on the digital copying machine icon 302f 
and thus the copying function is executed. 

First, in a step S901, it is judged whether or not 
the combination document file is designated in the 
combination document file designation area 1201 on the 

25 virtual operation panel. If judged that the 

combination document file is not designated, the flow 
advances to a step S903 as it is. Conversely, if 
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judged that the combination document file is 
designated, the flow advances to a step S902 to display 
the icon of the combination document 1203a in the 
output order display area 1203 (in left justify). 
5 Next, in the step S903, it is judged whether or 

not the combination image is designated in the 
combination image data designation area 1202 on the 
virtual operation panel. If judged that the 
combination image is not designated, the flow advances 
10 to a step S905 as it is. Conversely, if judged that 

the combination image is designated, the flow advances 
to a step S904 to display the icon of the combination 
image 1203c in the output order display area 1203 (in 
left justify). 

15 Next, in the step S905, it is judged whether or 

not the output order change is instructed in the output 
order display area 1203 on the virtual operation panel. 
If judged that the output order change is not 
instructed, the flow advances to a step S907 as it is. 

20 Conversely, if judged that the output order change is 
instructed, the flow advances to a step S906 to change 
the output order of the icons in the output order 
display area 1203 in accordance with the output order 
change instruction, and the display the icons in the 

25 changed output order. 

Next, in the step S907, it is judged whether or 
not the copying start is instructed by using the 
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copying start button 415 on the virtual operation 
panel. If judged that the copying start is not 
instructed, the flow returns to the step S901. 
Conversely, if judged that the copying start is 
5 instructed, the flow advances to a step S908 to acquire 
the setting on the virtual operation panel, and the 
flow further advances to a step S909 to perform the 
inputting firstly designated in the output order 
display area 1203 (i.e., the inputting corresponding to 

10 the icon displayed first from the left) in accordance 
with the acquired setting. 

Next, in a step S910, it is judged whether or not 
the inputting secondarily displayed in the output order 
display area 1203 is designated (i.e., the icon 

15 displayed second from the left exists). If judged that 
the inputting secondarily displayed is not designated, 
the flow advances to a step S914. Conversely, if 
judged that the inputting secondarily displayed is 
designated, the flow advances to a step S911 to perform 

20 the inputting secondarily designated in the output 
order display area 1203 (i.e., the inputting 
corresponding to the icon displayed second from the 
left ) . 

Next, in a step S912, it is judged whether or not 
25 the inputting thirdly displayed in the output order 
display area 1203 is designated (i.e., the icon 
displayed third from the left exists). If judged that 
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the inputting thirdly displayed is not designated, the 
flow advances to the step S914. Conversely, if judged 
that the inputting thirdly displayed is designated, the 
flow advances to a step S913 to perform the inputting 
5 thirdly designated in the output order display area 
1203 (i.e., the inputting corresponding to the icon 
displayed third from the left). 

Next, in the step S914, the first inputting to the 
third inputting are sequentially combined with others, 

10 and an output job of output format (including 

processing page layout depending on the output device, 
two- face printing, stapling, etc. ) based on the input 
and output settings on the virtual operation panel is 
generated. Then, in a step S915, the output job data 

15 and the images of the plural designated documents are 
transmitted in the designated order to the output 
device (the digital copying machine of the icon 302f in 
this case), and the processing ends. It should be 
noted that the job generation in the step S914 and the 

20 job transmission in the step S915 are performed every 
time the data of output one page is input. However, 
the job may be output after the data of plural pages is 
stored in a memory. 

According to the above processing, by outputting 

25 the plural input sources and their output order 

designated on one operation screen, it is possible to 
combine the information input from the plural user- 
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desired input sources in the user-desired order and 
then output the combination information from the output 
device selected by the user. Thus, for example, the 
image which is obtained by combining the document file, 
5 the image file and the like stored as the shared files 
in the user ! s own apparatus or other communicatable PC 
with the image read from the scanner can be output from 
the selected output device in the desired output 
format, e.g., two-face format, 2-in-l format or the 
10 like. 

Further, the image which is obtained by combining 
the image read from two different- function scanners 
(e.g., a color scanner and a monochrome high-speed 
scanner) with each other can be output from the 

15 selected output device in the desired output format, 
e.g., two-face format, 2-in-l format or the like. 

Further, in the case where the image obtained by 
combining the images respectively read from the two 
scanners having equivalent functions with each other is 

20 output from the selected output device in the desired 
output format, e.g., two-face format, 2-in-l format or 
the like, for example, even if the scanner having an 
ADF or the like can not be used when two originals are 
read, it is possible by reading the originals one by 

25 one from the plural scanner to read the two original 
without troublesomely exchanging the originals. It 
should be noted that, although the two scanners are 
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used in the present embodiment, three or more scanners 
may be used . 

Further, when the information input from the 
plural input sources (although the three input sources 
5 are used in the present embodiment, four or more input 
sources may be used) are combined with others in the 
designated order and then output, it is possible to add 
page numbers throughout the sheets on which images are 
formed and then output these sheets from the output 
10 device in the desired output format, e.g., two-face 
format, 2-in-l format or the like. 

For example, the above operation will be explained 
with reference to the screen shown in Fig. 42 as 
follows. The document which corresponds to the icon 
15 1203a displayed first from the left in the output order 
display area 1203 is the document which is generated 
based on the application program for the data 
processing apparatus (PC) and consists of five pages. 
The document corresponds to the second icon 1203b is 
20 the document which is to be input from the scanner 
corresponding to the icon 403a and consists of two 
pages. The third icon 1203c corresponds to the 
document which is input from other scanner on the 
network (a scanner 300 in Fig. 42) different from the 
25 scanner of the icon 403a and consists of three pages. 

In such display status of the output order display area 
1203, according as the button 415 is depressed by the 



- 106 - 



user, the three documents, i.e., the five-page image 
document corresponding to the icon 1203a read from the 
memory of the data processing apparatus, the two-page 
image document read from the scanner of the icon 403a, 
5 and the three-page image document read from the scanner 
300 are transmitted to the digital copying machine of 
the icon 302 f. The digital copying machine which 
received these three documents collects them into one 
document and performs the image formation. At this 
10 time, for example, page numbers (i.e., first to fifth 

pages) are formed together with the images respectively 
on the sheets (i.e., five sheets) to which the images 
of the document of the icon 1203a are to be formed, 
page numbers (i.e., sixth to seventh pages) are formed 
15 together with the images respectively on the sheets 

(i.e., two sheets) to which the images of the document 
of the icon 1203b are to be formed, and page numbers 
(i.e., eighth to tenth pages) are formed together with 
the images respectively on the sheets (i.e., three 
20 sheets) to which the images of the document of the icon 
1203c are to be formed. Then, for example, when the 
stapling is set by using the button B5 of Fig. 42, the 
stapling is performed to one sheaf of these ten-page 
sheets. Further, for example, before the button 415 is 
25 depressed, when the user drags the icon 1203c and drops 
it between the icons 1203a and 1203b by using the mouse 
13 of the data processing apparatus, the output order 
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is changed to the order of the documents 1203a, 1203c 
and 1203b. Then, if the button 415 is depressed, the 
digital copying machine of the icon 302 f which received 
these three documents forms the page numbers (i.e., 
5 first to fifth pages) together with the respective 

images on the sheets (i.e., five sheets) to which the 
images of the document of the icon 1203a are to be 
formed, forms the page numbers (i.e., sixth to eighth 
pages) together with the respective images on the 

10 sheets (i.e., three sheets) to which the images of the 
document of the icon 1203c are to be formed, and 
subsequently forms the page numbers (i.e., ninth to 
tenth pages) together with the respective images on the 
sheets (i.e., two sheets) to which the images of the 

15 document of the icon 1203b are to be formed. Thus, by 
operating and controlling the icons displayed on the 
output order display area 1203, it is possible to 
easily change the output order of the plural documents 
in the case where the plural documents from the plural 

20 image generation sources are collected and output. 

Further, in the present embodiment, the case of 
combining the information input from the plural input 
sources and then outputting the combination information 
was explained. However, it is possible to set an 

25 application program of image processing started by the 
user's own apparatus, combine the information input 
from the plural input sources in the designated order, 
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and embed the combination information in such the 
application program itself. 

Thus, without performing the conventional 
complicated input operation of independently inputting 
5 the information from the plural input sources and then 
combining the input information, it is possible by only 
designating the input sources and the combination order 
to embed the combination information obtained by freely 
combining the information input from the plural input 
10 sources in the designated order, in the application 
program . 

It should be noted that, in each of the above 
embodiments, the printer may be an electrophotographic- 
system printer, an inkjet-system printer, a 

15 sublimation-system printer or other-system printer, and 
the scanner may be a flatbed-system scanner or other- 
system scanner . 

Further, it should be noted that the peripheral 
devices on the network are not limited to the printer, 

20 the scanner and the digital copying machine. Namely, a 
digital camera, a modem and other devices may be used 
as the peripheral devices. In this case, like the 
printer, the scanner and the digital copying machine, 
the peripheral devices such as the digital camera, the 

25 modem and the like can be displayed on the system 

structure screen of Fig. 11 by using the icons of which 
shapes are close to the respective appearances of these 
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devices. Besides, like the printer, the scanner and 
the digital copying machine, the peripheral devices 
such as the digital camera, the modem and the like can 
be designated as the input and output devices, thereby 
executing the above various combination functions 
( multif unctions ) . 

Hereinafter, the structure of the data processing 
program which is readable by the data processing 
apparatus according to the present invention will be 
explained with reference to a memory map shown in Fig. 
46. 

Fig. 46 is the view for explaining the memory map 
of a storage medium in which the various data 
processing programs readable by the data processing 
apparatus according to the present invention are 
stored. 

Although the drawing is silent, information (e.g., 
version information, a programmer's name, etc.) for 
managing program groups stored in the storage medium is 
also stored in the storage medium. Further, 
information which depends on an OS (operating system) 
on the program reading side (e.g., an icon for 
discriminatingly displaying a program) is occasionally 
stored in the storage medium. 

Further, data which depend on the various programs 
are also managed in the directory. When an installed 
program or data is compressed, a program for 
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decompressing it is occasionally stored. 

Further, each of the functions of the above 
embodiments shown in Figs. 9, 32, 34, 35, 38, 40, 41 
and 45 may be executed by a host computer in accordance 
5 with an externally installed program. In this case, 

the present invention is applicable to a case where an 
information group including the program is supplied 
from a storage medium such as a CD-ROM, a flash memory, 
an FD or the like or external storage medium through 

10 the network to the data processing apparatus. 

As described above, it is needless to say that the 
object of the present invention can be achieved in a 
case where the storage medium storing the program codes 
of software for realizing the functions of the above 

15 embodiments is supplied to a system or an apparatus and 
then a computer (or CPU or MPU) in the system or the 
apparatus reads and executes the program codes stored 
in the memory medium. 

In this case, the program codes themselves read 

20 from the storage medium realize the new functions of 
the present invention, and the storage medium storing 
such the program codes constitute the present 
invention. 

The storage medium storing the program codes can 
25 be, e.g., a floppy disk, a hard disk, an optical disk, 
a magnetooptical disk, a CD-ROM, a CD-R, a magnetic 
tape, a non-volatile memory card, a ROM, an EEPROM, or 
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the like. 

Further, it is needless to say that the present 
invention also includes not only the case where the 
functions of the embodiments are realized by executing 
5 the program codes read by the computer, but also a case 
where an OS (operating system) or the like functioning 
on the computer executes all the process or a part 
thereof according to the instructions of the program 
codes, thereby realizing the functions of the above 

10 embodiments. 

Further, it is needless to say that the present 
invention further includes a case where the program 
codes read from the storage medium are once stored in a 
memory provided in a function expansion board inserted 

15 in the computer or a function expansion unit connected 
with the computer, and a CPU or the like provided in 
the function expansion board or the function expansion 
unit executes all the process or a part thereof 
according to the instructions of such program codes, 

20 thereby realizing the functions of the above 
embodiments . 

Further, the present invention is applicable to a 
system composed of plural devices or to an apparatus 
including a single device. Further, it is needless to 
25 say that the present invention is applicable to a case 
where a program is supplied to a system or an apparatus 
to realize the functions of the above embodiments. In 
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this case, when the storage medium storing the program 
represented by software for realizing the present 
invention is read by the system or the apparatus, such 
the system or the apparatus can derive the effects of 
5 the present invention. 

Further, when the program represented by software 
for realizing the present invention is downloaded and 
read from a database on the network by a communication 
program, such the system or the apparatus can derive 

10 the effects of the present invention. 

As explained above, according to the above 
embodiments, in the data processing apparatus which can 
perform data communication with the various peripheral 
devices (the printer, the fax machine, the digital 

15 copying machine, the scanner, the digital camera, the 
modem, etc.) including the PC T s connected on the data 
communication path such as the LAN's 100, 120 and the 
like shown in Fig. 1, for example, the device driver 
information of Fig. 10, the device information of Fig. 

20 26, the status information of each peripheral device, 
the connection information of each device, the use 
condition of each device, the resource data of Fig. 18, 
and the like are acquired through the management server 
or directly from the various peripheral devices by the 

25 communication with these peripheral devices. Then, on 
the basis of the acquired information or the 
information managed in the user's own apparatus, in 
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order to enable on one screen (e.g., the screen shown 
in Fig. 5, 11, 33 or the like) displayed on the CRT 16 
of the data processing apparatus the user to identify 
or recognize as the visible image whether the device 
5 having what function exists on the system (i.e., the 

kind of device, the maker of device if it was made by a 
different manufacturer) and how the device is connected 
and disposed on the communication path, the icons 
classified for the respective functions of the devices 

10 actually connected on the data communication path are 

displayed on the screen of the CRT 16 together with the 
image representing this data communication path. In 
this case, the shape of the image representing the icon 
shows the appearance of the corresponding device. 

15 Thus, in order to be able to visually confirm the 
connection status between each device and the data 
communication path on the screen, the positions to 
which the image representing the communication path and 
each icon are disposed are determined on the screen in 

20 accordance with the actual connection status, and the 
image and the icon are disposed at the respective 
positions and displayed. In this case, the disposing 
statuses of the image representing the communication 
path and the icon are set close to those in the actual 

25 system as much as possible. For example, when in the 
actual system one printer is connected on the 
communication path through the scanner and the PC, the 
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image of the communication path and the icon of the 
printer are displayed with the icons of the scanner and 
PC placed between those on the screen of the CRT 16. 
Further, for example, when in the actual system one 
5 printer is directly connected on the communication path 
without any device such as the PC, the image of the 
communication path and the icon of the printer are 
displayed without any icon between those on the screen 
of the CRT 16 (see the screen of Fig. 11 and the like). 

10 Thus, user can confirm as the visual images on the 

screen of Fig. 11 or the like whether the device with 
what function (what type) is connected on the 
communication path, whether or not the device is 
connected on the communication path through another 

15 device, and, in the case where the device is connected 
on the communication path through another device, what 
the lying another device is. 

The icons classified for the respective functions 
have different displaying shapes for the respective 

20 functions. Moreover, even if the plural icons 

represent the plural devices of the identical function, 
these icons have different displaying shapes for the 
respective makers and for the respective types. 
Further, on the screen, the operation status (i.e., 

25 three jobs are currently spooled) or the like is 

displayed nearby the icon. When the device can cope 
with color processing, the corresponding icon added 
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with a color mark or the like is displayed. Further, 
when the device connected on the communication path and 
existing on the system is shared on the network but any 
driver software is not installed, the icon of the 
5 corresponding device is displayed in gray on this 

screen so as to make the displaying status of the icon 
of the corresponding device different from other icons. 
In this case, before this screen is displayed, it is 
judged in the data processing apparatus whether or not 

10 driver software has been installed for each of the 

plural devices shared on the network. When the device 
for which the driver software is not installed exists, 
such the device is specified. Further, when the device 
for which the driver software has been installed but 

15 which can not be selected (used) due to some troubles 

(e.g., no sheet, no toner, breakdown, etc.) exists, the 
impossibility mark or the like is added on the icon of 
the corresponding device and such the status is 
displayed (see Fig. 11, etc.). 

20 When the user performs the drag-and-drop operation 

of the icon on the system structure status screen of 
Fig. 5 or 11 displayed on the CRT 16 by using the 
cursor or the like, an arbitrary combination of the 
icons classified for the respective functions is 

25 instructed or designated. Thus the data processing 

apparatus judges whether or not the combination of the 
dragged- icon device and the dropped-icon device is 
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appropriate (i.e., effective or valid). When the data 
processing apparatus judges that such the combination 
is not appropriate (i.e., ineffective or invalid), this 
apparatus notifies the user of such a judged result and 
5 demands him to again perform the designation operation. 
Conversely, when the data processing apparatus judges 
that such the combination is appropriate, the screen 
shown in Fig. 5 or 11 is changed to the operation 
screen (e.g., the screen shown in Figs. 12 to 14) which 

10 displays at least the buttons capable of selecting the 
function (including the expanded function) executable 
by each device and the function executable by combining 
the plural devices. Then, when the output is 
instructed on this screen by the user (i.e., when the 

15 copying start button 415 is depressed), for example, 
the image is input from the scanner corresponding to 
the dragged icon, the input image is then transmitted 
to the printer corresponding to the dropped icon, and 
the image formation based on the mode set on the 

20 setting screen is performed. On the basis of the 
output instruction by such the combined functions, 
while the processing is being actually performed by 
using the devices of the corresponding icons, the 
screen as shown in Fig. 33 is displayed on the CRT 16, 

25 and a specific emphasis pattern (e.g., a blinking flash 
pattern) is added to each of the indicated icons to 
emphasis it. Further, the displaying status of the 
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indicated icon for each function is temporarily made 
different from the displaying status of other icons, 
and the communication path which is displayed on the 
screen and connects shortest the icons for the 
5 respective functions to which the network path is 

indicated is made different from other paths (see Fig. 
33) . 

As explained above, the system structure is 
discriminated by the specific icon capable of being 

10 discriminated for each function and displayed together 
with its use condition (the screen of Fig. 5 or 11). 
Namely, one icon selected from the discriminated and 
displayed icons is overlaid on other icon for 
combination function (multifunctional) processing 

15 intended by the user, and display of the operation 

status of the devices indicated by the icons is changed 
to other display (see the screen in Fig. 33), whereby 
the connection status of the devices which constitute 
the system can be displayed as the icons which are 

20 connected on the virtual network path. Thus, the user 
can visually confirm the running network structure and 
the connected peripheral devices as compared with the 
existing network structure without strangeness. 
Besides, the user can easily discriminate whether or 

25 not the user-selected input and output devices normally 
operate on the virtually displayed system, as compared 
with other non-selected icons. Thus, it is possible to 
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highly improve operability of the data processing 
apparatus in case of selecting each peripheral device 
connected on the network and issuing intended input and 
output instructions . 
5 Therefore, it is possible to derive a significant 

effect that, as the user visually confirms the entire 
system by means of the icons connected on the virtual 
network path, he can set the combination function of 
the devices on the network by performing a simple icon 
10 indication operation. 
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WHAT IS CLAIMED IS: 

1. A data processing apparatus which can perform 
data communication with various devices connected on a 
predetermined communication medium, comprising: 
5 acquirement means for acquiring a resource 

information structure and a status of each device by 
communicating with the various devices; 

management means for storing and managing the 
resource information structure and the status acquired 
10 by said acquirement means; and 

virtual system configuration display means for 
causing a display unit to display a system 
configuration based on the resource information 
structure and the status stored and managed by said 
15 management means, such that icons capable of being 

discriminated for respective functions are displayed to 
be connected on a virtual network path. 



2. An apparatus according to Claim 1, wherein the 
20 icon for each function is a specific icon which is 

allocated to a maker of each device and of which 
displaying form is different from others. 

3. An apparatus according to Claim 1, further 
25 comprising : 

first indication means for indicating an arbitrary 
combination of the icons for the respective functions 
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displayed on the display unit; and 

first judgment means for judging effectiveness of 
an arbitrary combination function indicated by said 
first indication means, 
5 wherein, when it is judged by said first judgment 

means that the combination function is effective, said 
virtual system configuration display means temporarily 
changes a display status of the icon for each function 
indicated by said first indication means from display 
10 statuses of other icons while the combination function 
is being executed. 



4. An apparatus according to Claim 1, further 
comprising: 

15 first indication means for indicating an arbitrary 

combination of the icons for the respective functions 
displayed on the display unit, 

wherein said virtual system configuration display 
means displays a path to connect shortest the icons for 

20 the respective functions indicated by said first 
indication means on the virtual network path in a 
displaying form different from a displaying form of 
other paths . 



25 



5. An apparatus according to Claim 4, wherein, 
when said virtual system configuration display means 
displays the path to connect shortest the icons for the 



respective functions indicated by said first indication 
means on the virtual network path in the displaying 
form different from that of other paths , said virtual 
system configuration display means adds a specific 
emphasis pattern to the indicated icons to emphasize 
and display these icons. 

6 . An apparatus according to Claim 1 , wherein the 
various devices include at least any of a printer , a 
fax machine, a digital copying machine, a scanner, a 
digital camera and a modem. 

7 . An apparatus according to Claim 1 , wherein 
said data processing apparatus can communicate with 
other data processing apparatus functioning as a 
management server . 

8. An apparatus according to Claim 7, wherein 
said other data processing apparatus updatably stores 
resources for displaying the resource information 
structure acquired from the various device and the 
status of each device. 

9. An apparatus according to Claim 1, wherein 
said acquirement means acquires the resource 
information structure from a device driver of each 
device . 
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10. An apparatus according to Claim 1, wherein 
the resource information structure is described based 
on a predetermined data structure. 

11. An apparatus according to Claim 8, wherein 
the resources include various icon image data for 
displaying the system configuration. 



12. An apparatus according to Claim 1, further 
10 comprising judgment means for judging whether or not 
each device is shared on a network and a driver has 
been installed in said data processing apparatus, 

wherein a displaying form of the icon 
corresponding to the device of which driver is not 
15 installed in said data processing apparatus is made 

different from a displaying form of the icon of other 
device in accordance with the judged result of said 
judgment means. 



20 13. An apparatus according to Claim 12 , wherein 

the icon corresponding to the device of which driver is 
not installed in said data processing apparatus is 
displayed in gray. 



25 



14. A data processing method in a data processing 
apparatus which can perform data communication with 
various devices connected on a predetermined 
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communication medium, said method comprising: 

an acquirement step of acquiring a resource 

information structure and a status of each device by 

communicating with the various devices; 
5 a management step of storing and managing the 

resource information structure and the status acquired 

in said acquirement step; and 

a virtual system configuration display step of 

causing a display unit to display a system 
10 configuration based on the resource information 

structure and the status stored and managed in said 

management step, such that icons capable of being 

discriminated for respective functions are displayed to 

be connected on a virtual network path. 

15 

15. A method according to Claim 14, wherein the 
icon for each function is a specific icon which is 
allocated to a maker of each device and of which 
displaying form is different from others. 

20 

16. A method according to Claim 14, further 
comprising: 

a first indication step of indicating an arbitrary 
combination of the icons for the respective functions 
25 displayed on the display unit; and 

a first judgment step of judging effectiveness of 
an arbitrary combination function indicated in said 
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first indication step, 

wherein, when it is judged in said first judgment 
step that the combination function is effective, said 
virtual system configuration display step temporarily 
5 changes a display status of the icon for each function 
indicated in said first indication step from display 
statuses of other icons while the combination function 
is being executed. 

10 17. A method according to Claim 14, further 

comprising: 

a first indication step of indicating an arbitrary 
combination of the icons for the respective functions 
displayed on the display unit, 

15 wherein said virtual system configuration display 

step displays a path to connect shortest the icons for 
the respective functions indicated in said first 
indication step on the virtual network path in a 
displaying form different from a displaying form of 

20 other paths. 

18. A method according to Claim 17, wherein, when 
said virtual system configuration display step displays 
the path to connect shortest the icons for the 
25 respective functions indicated in said first indication 
step on the virtual network path in the displaying form 
different from that of other paths, said virtual system 
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configuration display step adds a specific emphasis 
pattern to the indicated icons to emphasize and display 
these icons . 

5 19. A method according to Claim 14, further 

comprising a judgment step of judging whether or not 
each device is shared on a network and a driver has 
been installed in said data processing apparatus, 
wherein a displaying form of the icon 
10 corresponding to the device of which driver is not 
installed in said data processing apparatus is made 
different from a displaying form of the icon of other 
device in accordance with the judged result in said 
judgment step. 

15 

20. A method according to Claim 19, wherein the 
icon corresponding to the device of which driver is not 
installed in said data processing apparatus is 
displayed in gray. 

20 

21. A storage medium which stores a computer- 
readable program to control a data processing apparatus 
capable of performing data communication with various 
devices connected on a predetermined communication 

25 medium, said program comprising: 

an acquirement step of acquiring a resource 
information structure and a status of each device by 
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communicating with the various devices; 

a management step of storing and managing the 
resource information structure and the status acquired 
in said acquirement step; and 

a virtual system configuration display step of 
causing a display unit to display a system 
configuration based on the resource information 
structure and the status stored and managed in said 
management step, such that icons capable of being 
discriminated for respective functions are displayed to 
be connected on a virtual network path. 

22. A storage medium according to Claim 21 , 
wherein the icon for each function is a specific icon 
which is allocated to a maker of each device and of 
which displaying form is different from others. 

23. A storage medium according to Claim 21, 
wherein said program further comprises: 

a first indication step of indicating an arbitrary 
combination of the icons for the respective functions 
displayed on the display unit; and 

a first judgment step of judging effectiveness of 
an arbitrary combination function indicated in said 
first indication step, 

wherein, when it is judged in said first judgment 
step that the combination function is effective, said 



- 127 - 



virtual system configuration display step temporarily 
changes a display status of the icon for each function 
indicated in said first indication step from display 
statuses of other icons while the combination function 
5 is being executed. 



24 * A storage medium according to Claim 21, 
wherein said program further comprises: 

a first indication step of indicating an arbitrary 
10 combination of the icons for the respective functions 
displayed on the display unit, 

wherein said virtual system configuration display 
step displays a path to connect shortest the icons for 
the respective functions indicated in said first 
15 indication step on the virtual network path in a 

displaying form different from a displaying form of 
other paths. 

25. A storage medium according to Claim 24, 
20 wherein, when said virtual system configuration display 
step displays the path to connect shortest the icons 
for the respective functions indicated in said first 
indication step on the virtual network path in the 
displaying form different from that of other paths, 
25 said virtual system configuration display step adds a 
specific emphasis pattern to the indicated icons to 
emphasize and display these icons. 
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26. A storage medium according "to Claim 21, 
wherein said program further comprises a judgment step 
of judging whether or not each device is shared on a 
network and a driver has been installed in said data 
5 processing apparatus, and 

wherein a displaying form of the icon 
corresponding to the device of which driver is not 
installed in said data processing apparatus is made 
different from a displaying form of the icon of other 
10 device in accordance with the judged result in said 
judgment step. 



27. A storage medium according to Claim 26, 
wherein the icon corresponding to the device of which 
15 driver is not installed in said data processing 
apparatus is displayed in gray. 



28. A data processing apparatus which can perform 
data communication with plural devices connectable with 
20 a data communication path, comprising: 

display control means for displaying icons 
visually representing appearances of the devices 
connected on the data communication path, on a display 
unit, 

25 wherein said display control means displays, on 

the display unit, an image representing the data 
communication path together with the plural icons 
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respectively corresponding to the plural devices, and 
said display control means disposes and displays 
the icons nearby the image representing the data 
communication path according to a connection status of 
5 the data communication path and the devices. 



29. An apparatus according to Claim 28, wherein 
each of the plural devices has at least an independent 
function, and said display control means makes a 
10 displaying form of the icon different for each function. 



30. An apparatus according to Claim 29, wherein, 
even if the plural icons respectively represent the 
devices having an identical function, said display 
15 control means makes the displaying forms of these icons 
different from others according to makers different. 



31. An apparatus according to Claim 29, wherein 
the plural devices include a scanner, a printer and a 

20 digital copying machine, and 

said display control unit displays the icon 
visually representing the appearance of the scanner, 
the icon visually representing the appearance of the 
printer, and the icon visually representing the 

25 appearance of the digital copying machine on the 

display unit according as these devices are connected 
on the data communication path. 
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32. An apparatus according to Claim 31, wherein 
the plural devices include a fax machine, a digital 
camera and a modem, and 

said display control unit displays the icon 
5 visually representing the appearance of the fax 

machine, the icon visually representing the appearance 
of the digital camera, and the icon visually 
representing the appearance of the modem on the display 
unit according as these devices are connected on the 
10 data communication path. 



33, An apparatus according to Claim 31, further 
comprising first indication means for indicating an 
arbitrary combination of the icons from among the 

15 plural icons displayed on the display unit, 

wherein, according as the combination of the icons 
corresponding to the scanner and the printer is 
indicated by said first indication means, the scanner 
and the printer are cooperated with each other through 

20 the data communication path so as to execute a function 
equivalent to the function executable by the digital 
copying machine • 

34. An apparatus according to Claim 29, further 
25 comprising: 

first indication means for indicating an arbitrary 
combination of the icons from among the plural icons 
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displayed on the display unit; 

judgment means for judging whether or not the 
combination indicated by said first indication means is 
appropriate; and 
5 control means for cooperating, according to the 

judged result of said judgment means, each of the 
devices represented by the icons of the arbitrary 
combination indicated by said first indication means 
with others through the data communication path so as 
10 to execute an arbitrary combination function executable 
by the devices represented by the icons of the 
arbitrary combination . 



35. An apparatus according to Claim 34, wherein 
15 said display control means temporarily makes the 
displaying form of the icons of the arbitrary 
combination indicated by said first indication means 
different from the displaying form of the icons 
representing other devices, according as the 
20 combination function is executed by using the arbitrary 
combination function . 



36. An apparatus according to Claim 35, wherein 
said display control means displays a specific emphasis 
25 pattern nearby the icon of the arbitrary combination 
indicated by said first indication means. 
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37. An apparatus according to Claim 34, wherein, 
according as the combination function is executed by 
using the devices represented by the icons of the 
arbitrary combination, said display control means makes 

5 the displaying form of an image corresponding to a path 
connecting these devices with others on the image 
representing the data communication path different from 
the displaying form of an image corresponding to other 
path. 

10 

38. An apparatus according to Claim 34, wherein, 
according as the combination function is executed by 
using the devices represented by the icons of the 
arbitrary combination, said display control means 

15 temporarily makes the displaying form of the icon 

corresponding to the arbitrary device indicated by said 
first indication means different from the displaying 
form of the icon corresponding to other device, and 
makes the displaying form of an image corresponding to 

20 a path connecting these devices with others on the 
image representing the data communication path 
different from the displaying form of an image 
corresponding to other path. 

25 39. An apparatus according to Claim 28, wherein, 

according as the device of which driver is not 
installed in said data processing apparatus is 
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connected on the data communication path, said display 
control means makes a displaying form of the icon 
corresponding to the device of which driver is not 
installed different from a displaying form of the icon 
5 of other device. 



40. An apparatus according to Claim 39 , wherein 
said display control means displays in gray the icon 
corresponding to the device of which driver is not 
10 installed. 



41. An apparatus according to Claim 28, further 
comprising : 

acquirement means for acquiring data concerning an 
15 operation condition output by the device through the 
data communication path, 

wherein said display control means displays the 
data concerning the operation condition nearby the icon 
corresponding to the device of a data output source 
20 acquired by said acquirement means. 



42. An apparatus according to Claim 28, wherein, 
according as the device capable of inputting or 
outputting a color image is connected on the data 
25 communication path, said display control means displays 
a mark indicating such a fact nearby the icon 
corresponding to the device capable of inputting or 
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output-ting the color image. 

43. An apparatus according to Claim 28 , wherein, 
according as the device of which driver has been 

5 installed in said data processing apparatus but which 
can not be used is connected on the data communication 
path, said display control means displays a mark 
indicating such a fact nearby the icon corresponding to 
the unusable device. 

10 

44. A data processing method for a data 
processing apparatus which can perform data 
communication with plural devices connectable with a 
data communication path, said method comprising: 

15 a display control step of displaying icons 

visually representing appearances of the devices 
connected on the data communication path, on a display unit, 

wherein said display control step displays, on the 
display unit, an image representing the data 

20 communication path together with the plural icons 

respectively corresponding to the plural devices, and 

said display control step disposes and displays 
the icons nearby the image representing the data 
communication path according to a connection status of 

25 the data communication path and the devices. 



45. A storage medium which stores a program to 
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cause a data processing apparatus which can perform 
data communication with plural devices connectable with 
a data communication path, to execute following step: 
a display control step of displaying icons 
5 visually representing appearances of the devices 

connected on the data communication path, on a display 
unit, 

wherein said display control step displays, on the 
display unit, an image representing the data 
10 communication path together with the plural icons 

respectively corresponding to the plural devices, and 

said display control step disposes and displays 
the icons nearby the image representing the data 
communication path according to a connection status of 
15 the data communication path and the devices. 
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ABSTRACT OF THE DISCLOSURE 

The present invention allows a structure of an 
entire system including various peripheral devices to 
be visually confirmable, allows a user to easily grasp 
5 or see the entire system, and allows the entire system 
to be effectively used. Thus, a CPU acquires a 
resource information structure and a status of each 
peripheral device by communicating with these devices, 
and a virtual system configuration display unit causes 

10 a display unit to display a system configuration based 
on the acquired resource information structure and each 
peripheral device status such that specific icons 
capable of being discriminated for respective functions 
are displayed to be connected on a virtual network 

15 path. 
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